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SECTION  1 


INTRODUCTION  AND  SUMMARY 


The  goal  of  this  research  program  is  the  advancement  of  linear  control  de¬ 
sign  technology.  The  initial  focus  of  the  program  was  to  advance  linear 
optimal  design  techniques  so  that  they  would  yield  operational  control  laws 
that  met  conventional  design  specifications.  The  development  of  design  tech¬ 
niques  with  the  assumption  that  full  state  feedback  is  available  was  reported 
for  single  input  system  [1]  and  for  multi-input  systems  in  [2].  The  signif¬ 
icant  result  for  multi-input  systems  reported  in  [2]  was  the  characterization 
of  quadratic  weighting  matrices  in  terms  of  their  asymptotic  modal  proper¬ 
ties  (eigenvalues  and  eigenvectors  of  the  optimally  controlled  system),  and  a 
procedure  for  constructing  quadratic  weighting  matrices  based  on  desired 
modal  characteristics.  Direct  extensions  of  these  results  to  discrete  sys¬ 
tems  are  described  in  this  report  along  with  development  of  asymptotic 
expansions  for  the  control  law  and  the  eigenvalues  and  eigenvectors  of  the 
optimal  system. 

To  meet  conventional  specifications,  it  is  often  necessary  to  add  dynamic 
compensators  to  the  optimal  designs.  Issues  concerning  compensation  to 
achieve  desired  high  frequency  attenuation  and  system  bandwidth  were  inves¬ 
tigated,  and  it  was  found  that  compensators  reduce  stability  margins.  Noting 
that  Kalman  filters  have  features  in  common  with  compensators  and  recog¬ 
nizing  that  operational  control  systems  would  often  lack  the  luxury  of  full 
state  measurement  so  that  some  form  of  state  estimation  must  be 


incorporated,  the  stability  margins  of  linear  quadratic  Gaussian  (LQG)  sys¬ 
tem  were  examined.  This  led  to  the  following  major  results: 

•  LQG  controllers  have  no  guaranteed  stability  margins.  This  is  in 
contrast  to  the  6  dB  and  60  degree  phase  margins  guaranteed  for 
linear  optimal  controllers  using  state  feedback. 

•  Introduction  of  an  additional  Kalman  filter  design  parameter  in  the 
synthesis  of  LQG  controllers  leads  to  improved  stability  margins 
which  can  be  made  arbitrarily  close  to  those  of  the  full  state 
feedback  controllers. 

These  results  led  to  further  investigation  of  the  loop  transmission  properties 
of  multivariable  systems.  A  meaningful  characterization  of  these  properties 
in  terms  of  the  singular  values  and  singular  vectors  of  the  system  was  de¬ 
veloped  which  provides  a  natural  generalization  of  the  scalar  stability  margin 
concept  for  single  input/single  output  systems.  This  characterization  was 
used  to  develop  compensation  structures  for  achieving  desired  transmission 
loop  properties.  The  characterization  also  provides  a  potentially  useful  al¬ 
ternate  method  for  selecting  quadratic  weights  for  the  linear  quadratic  state 
feedback  (LQ)  design  problem. 

The  refinements  of  the  characterization  of  linear  optimal  controllers  on  the 
basis  of  asymptotic  modal  properties  is  described  in  Section  2  and  Appen¬ 
dixes  A  and  B.  The  results  of  the  investigation  of  the  loop  transmission 
properties  are  presented  in  Section  3  and  Appendixes  C  through  I. 


SECTION  2 


REFINEMENTS  OF  THE  ASYMPTOTIC  MODAL  PROPERTIES 
OF  LINEAR  OPTIMAL  CONTROLLERS 


In  reference  [2]  quadratic  performance  indices  were  characterized  in  terms 
of  asymptotic  eigenvalues  and  eigenvectors.  That  is,  for  an  n^  order  sys¬ 
tem  with  m  inputs 


x  =  Fx  +  Gu 


(1) 


the  quadratic  performance  index 


/T  9  T 

(x  Qx  +  p  u  Ru)  dt 


maybe  characterized  by  the  asymptotic  behavior  of  the  closed-loop  eigen¬ 
values  and  eigenvectors  as  the  parameter  p  tends  to  zero.  Furthermore, 
a  procedure  was  described  in  [2]  for  defining  the  weighting  matrices,  Q  and 
R,  on  the  basis  of  desired  asymptotic  eigenvalues  and  eigenvectors  in  the 
case  where  n-m  of  the  desired  asymptotic  eigenvalues  are  finite. 


An  alternative  approach  to  defining  the  weighting  matrices  on  the  basis  of 
desired  asymptotic  modal  properties  was  developed  which  is  applicable  to 
the  above  case  and  to  the  case  in  which  there  are  more  than  n-m  asymptotic 
eigenvalues  that  are  finite.  This  alternative  approach  also  yields  the  two 
leading  terms  in  the  asymptotic  expansion  of  the  optimal  control  law.  The 
details  of  this  approach  are  given  in  Appendix  A. 
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A  method  was  also  developed  for  find'  lg  the  leading  terms  in  the  asymptotic 
expansions  of  the  eigenvalues  and  eigenvectors  of  the  optimal  system  as  well 
as  the  gain  matrix  of  the  optimal  control  system.  This  method  as  described 
in  Appendix  B  may  be  used  to  analyze  the  asymptotic  properties  of  any  given 
quadratic  weighting  matrices. 

Reference  [3]  provides  a  further  generalization  of  the  asymptotic  modal 
properties  to  the  case  where  there  are  less  than  n-m  asymptotic  finite 
eigenvalues  with  the  remaining  eigenvalues  tending  to  infinity  in  selectable 
Butterworth  patterns. 

In  addition  to  the  above  developments,  the  characterization  of  performance 
indices  given  in  [2]  for  continuous  systems  was  extended  to  discrete  systems 
as  follows.  Consider  the  controllable  discrete  system 

\+l  ’  Axk  +  BV  xo  given  <3) 

where  x^  is  an  n-vector,  u^  is  an  m-vector  with  m  5  n,  and  the  rank  of  B 
is  m.  The  optimal  quadratic  performance  index  for  this  system  is 

J  =  2  (xkTCTCxk  +  p2ukRuk)  (4) 

k=0 


Let  us  assume  that  the  pair  (C,  A)  is  observable,  the  matrix  CB  has  rank  m, 
and  that  A  is  nonsingular.  This  last  assumption  on  the  nonsingularity  of  A  is 
equivalent  to  the  assumption  that  there  are  no  pure  time  delays.  It  could  be 
relaxed  but  leads  to  special  cases  requiring  special  treatment. 
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The  optimal  control  is  given  by 


uk  ■ 


2  T  -1  T 

K  =  -  (  p  R  +  B  PB)  B  PA 


where  P  is  the  positive  definite  symmetric  solution  of 


T  T  TT2  T-1T 

P  =  A  PA  +  C  C  -  (B  PA)  {  D  R  +  B  PB)  B  PA 


The  return  difference  matrix  is 


T(z)  =  I  -  K(zl-A)  B 


and  the  determinant  of  T(z)  is 


det  (T(Z)) 


| zl  -  A  -  BK |  *c(z) 


zl  -  A1 


*o(z) 


where  0c(z)  is  the  closed-loop  characteristic  polynomial  and  tfQ(z)  is  the 

open-loop  characteristic  polynomial.  Multiplying  equation  (7)  on  the  left  by 

T  -1  T  -1  -1 

B  (z  I  -  A  )  and  on  the  right  by  (zl  -  A)  B,  and  using  equations  (4) 

and  (8),  algebraic  manipulation  yields 


TT(z_1)  (  p2R  +  BTPB)  T  (z) 


2  T  -1  T  -1  T  -1 

p  R  +  B  (z  I  -  A  )  C  C  (zl  -  A)  B 
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It  is  possible  to  equate  the  determinants  of  both  sides  of  equation  (10)  and 
examine  the  asymptotic  nature  of  the  eigenvalues  of  the  closed-loop  system 
as  p  tends  to  zero.  However,  in  this  discrete  case  the  solution  exists  for 
p  =  0  (namely,  P  =  C  C,  and  K  =  -(CB)  CA  ,  and  the  limiting  behavior 
can  be  determined  directly.  Setting  p  =  0  and  equating  the  determinants  of 
the  two  sides  of  equation  (10)  yields 


det  (B  rPB)  =  det  [HT(z_1)  H(z)] 


where 


0c(z_1) 

*  c(z) 

‘o<rl) 

«o(z) 

H(z)  =  C(zl-A)  B 

It  is  convenient  to  introduce  the  following  additional  notation. 


n 

n 

TT 

i=l 

(z 

-z.  ), 

lO 

0  (z) 
o 

=  a  IT 

°  i=l 

(1-zz.  ) 
lO 

n 

n 

TT 

i=l 

(z 

-Zic>' 

Vz) 

=  a  TT 

C  i=l 

d-zz  ) 

1C 

n-m 

Z 

N 

•  H 

CL 

i)  / 

0  (Z), 
o 

P  n-m  ^ 

0 

Then 


1  1  “*  n 

<b  (z-1)  =  z“n  0  (z),  0  (z“  )  =  z"  %  (z), 
o  o  c 
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and 


,  n-m 

det  H(z  )  =  zm  E  P.z11  m  l)  I  <t>  (z) 
i=0  1 

so  that  equation  (11)  may  be  written  as 

n-m  n-m 

<t>  (z)  %  (z)det(B  PB)  =  zm  (  E  p.z1)  (E  p  .zn"m_1)  (13) 

C  C  .  ..  1  .  ,  1 

1=1  1-1 

Thus  there  are  m  closed-loop  eigenvalues  at  the  origin  and  the  remaining 
n-m  closed-loop  eigenvalues  are  at  the  zeros  of  the  determinant  of  H(z) 
or  their  inverses,  whichever  have  magnitudes  less  than  one. 

The  m  eigenvectors  x^,  associated  with  the  zero  eigenvalues  are  charac¬ 
terized  by  the  equation 

x.  =  A  ^By.,  i  =  1,  2,  ....  m  (14) 

where  y^  are  m  linearly  independent  m-dimensional  vectors.  If  C  is 
such  that  all  the  zeros,  z  ,  of  det  (H(z))  have  magnitude  less  than  unity,  then 

the  corresponding  eigenvectors  are  characterized  by 

\ 

x.  =  (z.I  -  A)  1By.,  i  =  1,  2,  ....  n-m  (15) 

l  l  l 


Assuming  z.  is  not  an  eigenvalue  of  A. 
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where  the  m-dimensional  vectors  yi  satisfy 

C(z.I  -  A)"1BY.  =  0  (16) 

Thus,  a  constructive  procedure  to  approximately  achieve  desired  modal 

properties  for  discrete  systems  consists  of  specifying  the  desired  properties 

in  terms  of  n-m  desired  eigenvalues  zrf  and  the  corresponding  eigenvalues 

x  .  Then,  find  the  closest  achievable  eigenvalues  and  eigenvectors.  For 

example,  take  x.  to  be  the  closest  achievable  vector  to  xd  corresponding 

to  z  ,  --i.  e.  , 
di 

x.  =  (z  I  -  A)  *By.  (1?) 

id.  i 

l 

where 

y  =  min  ||xd  -  (zd  I  -  A)"1By|  |  (18) 

i  i 

for  i  =  1,2,...,  n-m  and  then  choose  C  to  be  orthogonal  to  each  x.  sub¬ 
ject  to  the  conditions  that  Rank  C  =  CB  =  m,  and  (C,  A)  observable. 

Of  course,  other  methods  of  approximation  may  be  used.  Other  special 
cases  such  as  more  than  m  zero  eigenvalues,  desired  eigenvalues  coinciding 
with  open-loop  eigenvalues,  systems  with  pure  time  delays,  etc.  ,  may  be 


Assuming  z  is  not  an  eigenvalue  of  A. 
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treated  in  a  similar  fashion,  but  the  number  of  such  cases  and  the  special 
complexities  introduced  preclude  their  treatment  here. 


SECTION  3 


LOOP  TRANSMISSION  PROPERTIES  OF  MULTIVARIABLE  SYSTEMS 


While  LQ  designs  provide  guaranteed  stability  margins,  they  require  full 
state  feedback  and  force  the  feedback  loop  to  have  a  high  frequency  rolloff 
rate  of  only  1/s.  In  order  to  implement  an  LQ  design,  a  Kalman  filter  or 
observer  may  be  needed  to  reconstrvict  a  state  estimate  from  measured 
outputs.  Furthermore,  additional  dynamic  compensation  may  be  required  to 
provide  adequate  high-frequency  attenuation.  Each  of  these  two  forms  of 
dynamics  in  the  feedback  path  may  significantly  reduce  the  stability  margins 
for  the  final  design. 

The  standard  LQG  design  employs  a  Kalman  filter  to  construct  an  input  using 
a  quadratic  optimal  state  feedback  gain  on  the  state  estimate.  In  Appendix  C 
we  present  an  example  of  a  legitimate  LQG  controller  which  has  vanishingly 
small  stability  margins.  Thus,  the  loop  transmission  properties  of  LQG 
controllers  must  be  checked  for  each  design  and  compensation  either  added 
or  adjusted  as  appropriate. 

In  order  to  achieve  desired  feedback  loop  transmission  properties  we 
require: 

1.  A  means  of  characterizing  the  loop  transmission  properties  and 
specifying  what  is  desirable. 

2.  Compensation  structures  which  provide  for  loop  shaping. 
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3.  Methods  for  adjusting  the  feedback  gains  and/or  Kalman  filter. 


4.  The  characterization  of  loop  transmission  properties  leads  to  an 
alternative  method  for  selecting  quadratic  weighting  matrices. 

These  four  aspects  are  treated  in  order  below. 

CHARACTERIZATION  OF  LOOP  TRANSMISSION  PROPERTIES 

Consider  the  linear,  time-invariant  feedback  system  in  Figure  1  where  for 
simplicity  the  plant  and  all  compensation  have  been  lumped  into  the  transfer 
function  Q(s).  We  will  be  concentrating  on  the  feedback  properties  of  this 
system  where  Q(s)  may,  in  general,  be  a  transfer  function  matrix. 


Figure  1.  Feedback  System 
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The  critical  feedback  issue  is  to  provide  desired  performance  in  the  face  of 
plant  uncertainty  (see  Appendix  D;  also,  [4]).  The  effect  of  feedback  on  a 
system's  uncertainty  is  related  to  its  loop  transmission  properties,  which 
for  single  input/output  systems  are  most  naturally  and  usefully  character¬ 
ized  in  terms  of  the  frequency  response  of  the  loop  transfer  and  return 
difference  functions  (Q(s),  1  +  Q(s),  1  +  1/Q(s)).  This  is  often  represen¬ 
ted  in  various  graphical  forms  such  as  Bode  plots,  Nyquist  and  Inverse 
Nyquist  Diagrams,  and  Nichols  charts. 

For  multiple  input/output  systems,  the  analogous  characterization  of  the  loop 
transmission  properties  is  in  terms  of  the  singular  values  and  vectors  of  the 
corresponding  feedback  matrices  (Q(s),  I  +  Q(s),  I  +  Q(s)  *).  Appendix  E 
develops  this  concept  and  demonstrates  the  applicability  of  singular  value 
analysis  to  issues  of  robustness  for  multivariable  systems.  The  major 
results  are: 

•  The  gain  and  rotation  properties  of  a  transfer  function  matrix  Q(s) 
may  be  characterized  in  terms  of  the  singular  values  and  vectors  of 
Q(juu)  as  a  function  of  w 

•  The  robustness  properties  of  the  feedback  system  in  Figure  2  may 
be  characterized  in  terms  of  the  singular  values  and  vectors  of 

I  +  Q  1(s)  and  I  +  Q(s).  In  particular,  for  the  system  in  the  figure 
where  L(s)  represents  a  stable  perturbation  matrix  of  a  nominally 
stable  feedback  system,  the  perturbed  system  will  remain  stable  if 

a  (I  +  Q  1(jou))  >  a  (L  (ja> )  )  for  all  ou 
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Figure  2.  Perturbed  Feedback  System 

where  a  and  a  denote  minimum  and  maximum  singular  values, 
respectively.  This  gives  a  measure  of  system  robustness  in  terms 
of  a  (I  +  Q  1(j(U)  )  which  is  analogous  to  the  distance  from  the 
critical  point  on  an  Inverse  Nyquist  Diagram. 

The  above  bound  is  tight  in  the  sense  that  for  each  frequency  a  de¬ 
stabilizing  L  exists  with  a  (L)  a  a  (I  +  Q  1).  Such  a  destabili¬ 
zing  L  may  not  necessarily  be  rational  or  even  causal. 

•  Some  alternative  approaches  for  evaluating  multivariable  stability 
margins  have  been  shown  to  be  inadequate.  In  particular,  loop 
breaking.  Characteristic  Loci  and  methods  based  on  diagonalization 
give  unreliable  information  on  robustness. 
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•  Two  somewhat  popular  control  design  methodologies  which  use  the 
Inverse  Nyquist  Array  and  Characteristic  Loci  in  an  attempt  to  ex¬ 
tend  frequency  response  methods  to  multiloop  problems  have  been 
examined  in  light  of  our  recent  results  and  have  been  found  wanting. 
Details  are  in  Appendixes  F  and  G. 

•  Additional  insight  into  system  behavior  may  be  gained  by  examining 
singular  values  of  matrices  as  a  function  of  s  and  not  just  j ou .  This 
leads  to  mappings  defined  on  multiple  copies  of  the  complex  plane 
forming  Riemann  surfaces.  See  Appendix  H  for  details. 

•  The  robustness  aspects  of  the  singular  value  approach  fits  neatly 
into  the  more  general  stability  theory  developed  by  Safonov  [5]. 
Determination  of  the  implications  of  this  will  require  further 
research. 

LOOP  SHAPING  BY  DYNAMIC  COMPENSATION 

In  order  to  achieve  desirable  loop  transmission  properties,  it  is  often  nec¬ 
essary  to  add  additional  dynamic  compensation  in  the  feedback  path.  This 
compensation  may  significantly  alter  not  only  the  loop  transmission  proper¬ 
ties,  but  also  the  closed-loop  behavior  of  the  system.  Since  we  have  char¬ 
acterized  the  plant  performance  in  terms  of  modal  properties,  it  would  be 
desirable  to  find  compensation  structures  which  preserve  the  closed-loop 
plant  eigenvalues  and  eigenvectors  associated  with  the  original  full  state 
feedback  design.  Since  it  is  well  known  that  use  of  an  observer  or  filter  to 
reconstruct  the  input  signal  preserves  closed-loop  plant  modal 
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characteristics,  mode  preserving  compensation  structures  would  provide  a 
complete  methodology  for  implementation  of  feedback  designs  based  on  modal 
properties. 


We  will  begin  by  considering  the  compensation  problem  for  single  input  sys¬ 
tems.  Suppose  we  have  the  state  feedback  system 

x  =  Ax  +  bu  (19) 


u  =  f^x 


where  xeRn.  Then 


fjlsl  -  A)-1b 


n^s) 

dTlT) 


and 


1  +  fj  (si  -  A)_1b 


n  (s)  +  d  (s) 
1 _ o 

do(s) 


fc<f> 

do(s) 


(20) 


(21) 


(22) 


where 


d  (s)  =  det(sl  -  A)  =  s11  +  a  s"'1  +  ...  a  ,s  +  a  (23) 

°  1  n-1  n 

is  the  open-loop  characteristic  polynomial  and 

d  (s)  =  det(sl  -  A  +  bf  )  =  sn  +  c  s*1-1  +  ...  c  .  s  +  c  (24) 
c  11  n-1  n  ' 
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is  the  closed-loop  characteristic  polynomial. 


In  order  to  add  compensation  without  changing  the  closed  loop  plant  eigen¬ 
values  we  must  find  d  (s)  and  f  such  that 

P  2 

1  +  dlij  f2(Sl  -  A)'lb 

P 

n2(s)  +  dQ(s)dp(s) 

d  (s)d  (sj 
o  p 


d  (s)d  (s) 
c  r 


d  (s)d  (s) 

o  p 


(25) 


where  n  (s)  =  d  (s)f  (si  -  A)_1b  is  a  polynomial  of  order  no  greater  than 
2  o  2 

n  -  1. 


Let 


dp(s)  =  sm  +  Sj3"1  "  1  +  -  !S  +  gm 


(26) 


.  .  .  m  .  m  —  1  .  .  i_ 

dr(S)  =  s  +  hjS  +  •••  hm  -  Is  +  hm 


(27) 


Then 


n2(s>  =  dc(s)dr(s)  -  dQ(s)dp(s) 


(28) 
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implies  that  the  first  n-m  coefficients  of  dc(s)dr(s) 
This  in  turn  implies  that 


d  (s)d  (s)  be  zero, 
o  p 


h,  =  g.  +  (c-  -  a  ) 


h2  '  *2  +  (C2  ‘  a2>  +  <C1  ‘  al>  <«1  '  al> 


(29) 


h3  =  g3  +  (C3  '  a3>  +  ,C2  -  V  (61  '  al>  + 


(°1  -  ax)  <g2  -  a2  -  a2  -  al8l) 


etc. 


By  thus  restricting  d^(s)  and  d^(s)  we  guarantee  that  we  can  find  a  state 
feedback  f^  such  that  equation  (25)  is  satisfied.  This  allows  us  to  concen¬ 
trate  on  the  adjustment  of  the  parameters  in  the  compensator  while  main¬ 
taining  the  desired  closed-loop  plant  modal  properties. 


As  a  simple  example  consider  a  system  with 


d  (s)  =  s  -  2s  +  26 
o 


with  open  loop  poles  at  1  +  5j  and 


d  (s)  =  s  +  10s  +  50 
c 


(30) 


(31) 


with  closed  loop  poles  at  -5  ■+■  5j.  We  will  consider  several  cases: 


A.  no  compensation, 

with  d^s)  =  s  +  g  , 

d  (s)  =  s  +  gl  +  12, 

B.  gj  =  10, 

C.  gj  _  6, 

D.  gl  =  4, 

2 

and  with  d^s)  =  s  +  gjS  + 

dp(s)  =  s2  +  (gj  +  12)s  +  g2  +  12g1  +  48, 

E.  g  =  20,  g2  =  100  poles  (-10,  -10) 

F.  gj  =  12,  g2  =  70  poles  (-6  +  5.  6j) 

The  Nyquist  diagrams  are  shown  for  cases  A,  B,  and  D  in  Figure  3  and  for 
cases  C,  E,  and  F  in  Figure  4.  The  locp  gain  Bode  plots  are  shown  in 
Figures  5  and  6.  Note  that,  as  expected,  bandwidth  is  reduced  at  the  expense 
of  gain  and  phase  margin.  The  parameters  may  be  adjusted  until  an  adequate 
trade-off  is  achieved. 


(34) 

(35) 


(32) 

(33) 
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Figure  4.  Nyquist  Diagrams  for  Cases  C,  E,  and  F 
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The  compensation  problem  becomes  substantially  more  complicated  for 
multiple  input  problems. 

Suppose  we  have  a  state  feedback  design 

x  =  A^x  +  Bu  (36) 

u  =  -Fx  (37) 

where  the  loop  transfer  function  is 

F(sl  -  A1)“1B  (38) 

This  design  is  assumed  to  have  desirable  properties  in  terms  of  the  closed- 
loop  eigenvalues  and  eigenvectors. 

These  may  be  related  directly  to  the  feedback  gains  [6].  Let  s.  and  v.  denote 
the  ith  closed-loop  eigenvalue  and  eigenvector,  respectively.  Then  there 
exists  a  w.eCm  such  that 


(s.I  -  A.)v.  =  -Bw.  (39) 

1111 

for  each  i,  i  =  1,  ....  n.  Then 

F  =  WV"1  (40) 

where  W  =  [w w  ]  and  V  =  [v, , . . . ,  v  ].  Also 
L  1  n  1  1  nJ 
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I 


VS  -  AV  =  BW 


where  S  =  diag  [s^,  ....  s^].  Two  types  of  compensation  may  be  used: 


1.  Compensation  on  Inputs 


-1  -1 

Let  -{si  -  A.^)  A^FfsI  -  Aj)  B  be  the  compensated  loop  transfer  func- 

A 

tion  and  F  the  new  feedback  matrix.  In  order  that  the  closed-loop  eigen¬ 
values  and  eigenvectors  of  the  plant  remain  the  same  it  is  necessary  that 


v.  =  (s.I  -  A  )_1B(s .1  -  A  )_1  Aqw. 

1  1  1  1  Ct  ta  1 


(s.I  -  A  )  Bw. 


This  implies  that 


w.  =  (si 
l 


A2)  1-^2Wi 


W  =  A?  WS  -  W, 


F  =  WV 
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Then  the  compensated  loop  transfer  matrix  has  the  form 


-(si  -  A2)-1A2(W  -  A21WS)V_1(sI  -  A^B 

=  -(si  -  A2)_1(A2W  -  WS)V_1(sI  -  Aj)'^  (46) 

with  closed-loop  plant  eigenvalues  {s.j  and  eigenvectors  {v.  ].  The  A 2  may 
be  selected  to  shape  the  transfer  function  while  the  eigensystem  of  the  plot 
remains  fixed. 


Note  that  the  closed-loop  system  has  a  state  matrix 


-BF  A2 


and 


A1  B 

"  Ax  B 

Tr 

A 

=  Tr 

i 

i 

ffl 

> 

to 

1 _ 

- \ 

C<1 

< 

o 

_ 1 

(47) 


Since  the  trace  of  a  matrix  is  equal  to  the  sum  of  its  eigenvalues,  the  sums 
of  the  open  and  closed  loop  eigenvalues  are  the  same.  Thus,  there  is  one 
limitation  on  how  much  lag  may  be  introduced  before  instability  occurs. 


This  method  adapts  easily  to  allow  for  feedback  designs  which  do  not  include 
actuator  position  feedback- -i.  e. ,  A2  could  be  associated  with  actuator  states. 
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2.  Compensation  on  States 


In  a  similar  manner,  compensation  on  the  states  may  be  used  to  give  the  loop 
transfer  matrix 

-F(sl  -  A3)-1A3(sI  -  A1)_1B. 

It  is  easily  shown  that  to  preserve  the  original  closed  loop  eigensystem 

F  =  WV'1  (48) 


where 


AgV  -  VS  =  A3V.  (49) 

These  two  methods  may  be  combined  to  yield  a  loop  transfer  function  of 

(si  -  A2)-1(A2W  -  WS)V_1(sI  -  A3)-1A3(sI  -  A)-1B 

The  procedure  for  selecting  the  A 2  and  Ag  is  fairly  ad  hoc  and  amounts  to 
trial  and  error  shaping  of  the  singular  values.  In  practice,  A 2  and  A3  will 
generally  be  selected  as  diagonal,  and  simultaneous  loop  shaping  may  be 
done  by  adjusting  the  diagonal  elements.  The  procedure  outlined  above 
simply  provides  a  structure  that  preserves  the  closed-loop  eigensystem. 

All  of  this  depends,  of  course,  on  the  somewhat  dubious  assumption  that  the 
closed-loop  eigensystem  adequately  characterizes  the  plant  performance. 
Further  research  will  be  required  before  an  entirely  adequate  characteriza¬ 
tion  of  system  performance  is  obtained. 


26 


ADJUSTMENT  OF  OBSERVER /FILTER  DESIGN  TO  ACHIEVE  ROBUSTNESS 


Although  LQ  state  feedback  systems  have  guaranteed  stability  margins,  no 
such  guarantee  exists  for  the  full  LQG  system  with  Kalman  filter,  as  the 
example  in  Appendix  C  shows.  More  generally  the  robustness  properties  of 
any  state  feedback  design  may  be  seriously  degraded  when  that  design  is 
implemented  with  an  observer  or  filter.  In  such  situations,  a  systematic 
methodology  to  improve  the  robustness  of  the  final  design  would  be  desirable. 
We  have  developed  an  observer/filter  design  procedure  which  accomplishes 
this.  To  provide  insight  into  the  nature  of  the  trade-offs  involved,  we  pre¬ 
sent  the  results  in  terms  of  a  particular  equivalence  between  noise  response 
and  robustness. 

Two  properties  which  are  important  in  feedback  systems,  robustness  with 
respect  to  perturbations  and  noise  rejection,  may  be  viewed  as  two  aspects 
of  a  single,  more  fundamental  property.  To  see  this,  consider  a  closed- 
loop  LTI  feedback  system  where  some  set  of  p  points  in  signal  paths  have 
been  identified.  This  set  of  points  will  be  denoted  by  X.  These  may  be  any¬ 
where  in  the  system  such  as  in  feedback  loops  or  internal  signal  paths  where 
perturbations  occur,  or  places  where  noise  enters.  Suppose  the  system  has 
been  rearranged  to  isolate  the  selected  signal  paths  as  shown: 


\  / 


I  I 


Here  Q(s)  represents  the  Laplace  transform  function  of  the  whole  system  if 
the  loops  were  broken  at  the  selected  points,  X. 

Now  consider  two  possible  types  of  uncertainty  introduced  at  X,  a  perturba¬ 
tion  L  (nominally  zero) 


r-Y-^ 

T  4-  1 

_ 

Q(s) 

-tr* 

- ^ 

_  .  J 

of  bounded  spectral  norm  (as  a  function  of  frequency)  and  white  noise  w 


w 


,-w.  -  -  J 

Q(s) 

—h — ^ 

+ 

with  intensity  I.  (See  Appendix  E  for  more  details  on  perturbations  of  the 
type  indicated. ) 

It  has  been  shown  (Appendix  E)  that  the  system  will  remain  stable  for  arbi¬ 
trary  perturbations  L  provided 

£_  (I  ~  Q  1(jou)  )  >  |  |L|  |2  =  a  (L)  (50) 
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where  o ,  a,  and  I  |  •  |  L  denote  the  minimum  and  maximum  singular  values 

1  -X 

and  spectral  norm,  respectively.  Thus  a  (I  -  Q  )  characterizes  robustness 
of  Q  to  perturbations  L  at  X. 

Furthermore,  the  response  at  X  of  Q  to  noise  w  has  a  spectrum  in  terms 
of  [I  -  Q  1(juu)]  ,  and  the  maximum  response  is 

a(  [  I  -  Q-1(ju))  ]_1)  =  - — -  (51) 

MI  -  Q  1(j0,)) 

in  the  singular  vector  directions  associated  with  a.  Thus  <j(I  -  Q  *) 
characterizes  the  response  to  noise  w  at  X. 

It  can  now  be  clearly  seen  that  both  robustness  and  noise  rejection  depend  on 
o_(I  -  Q  1)  (or  more  generally  I  -  Q  *),  and  both  properties  are  improved 
when  this  quantity  is  large.  In  particular,  two  systems  which  have  identical 
response  to  noise  at  some  point  X  will  have  identical  robustness  with  re¬ 
spect  to  parameter  variations  at  X,  and  vice-versa. 

By  exploiting  this  equivalence  between  noise  response  and  robustness  it  is 
possible  to  design  Kalman  filters  strictly  on  the  basis  of  noise  response 
which  provide  desired  robustness  properties  when  used  for  feedback.  This 
is  easily  seen  by  considering  the  state  feedback  system 

x  =  Ax  +  Bu  +  Gw  (52) 

y  =  Cx  +  v  (53) 
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u  =  -Fx  (54) 

where  x  e  Rn  is  the  state,  u  e  is  process  noise  with  E  (w(t)  w(t)^)  = 

p 

W  (t-T),  y  eR  is  the  output,  and  v  *R  is  the  observation  noise  with 
T 

E  (v(t)  v  (t)  )  =  1/q  V  5  (t  -  t).  The  closed-loop  response  of  x  to  the  noise 

w  is 

x  =  (si  -  A  +  BF)"1  Gw.  (55) 

We  assume  that  the  transfer  function  C(sl  -  A  +  BF)  has  no  right-half 
plane  zeroes. 


Suppose  the  feedback  design  is  to  be  implemented  using  a  Kalman  filter  to 
generate  a  state  estimate  x  where 

x  =  (A  -  KC  -  BF)  x  +  Ky  (56) 


u  =  -Fx.  (57) 

with  K  being  the  Kalman  filter  gain.  Letting  e  =  x  -  x  we  can  write  the 
response  of  the  state  as 


x 


(si  -  A  +  BF) 


[Gw  +  BFe] 


(58) 


1 


where 

e  =  (si  -  A  +  KC)"1  [Gw  -  Kv]. 


(59) 
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,  2 

Suppose  r  =  p  and  let  the  observation  noise  intensity  1/q  V  go  to  zer.  ~>y 
letting  q  -»  ».  Then  asymptotically 

lim  •. 

K  ->  q  G  W1  V  “  (60) 

q  oo 

T 

where  W.  denotes  some  square  root  of  W  (W^  =  W)  and,  similarly, 

Vj  is  some  square  root  of  V.  Then 

e  =  (si  -  A  +  KC)"1  [Gw  -  Kv] 

-*  (si  -  A  +  qGW1V1"1C)“1[G  -  qGw^^v] 

=  (si  -  A)'1  G[I  +  qW1V1'1C(sI  -  A)‘1G]"1(w  -  qWjVj^v) 

->  (si  -  A)"1  G[W1V1-1C(sI  -  A)'1  G]"Vw  -  WjV^v)  (61) 

T 

Hence,  in  the  limit,  E[e(t)e(T)  }  0  since  E[w(0v(t)}  =  0  and 

E{—  w(t)[—  w(t  )]^}  =  E( W  V,  1  v(t)[W.  V  1  v(t  )]"^3  for  all  q  >  0. 
q  q  11  11 

Thus,  with  the  Kalman  filter  in  the  loop,  as  q-»  •,  the  noise  response  of  the 
state  asymptotically  approaches  that  for  the  full  state  feedback  design.  That 
is, 

x  -*  (si  -  A  +  BF)”1  Gw.  (62) 

Because  of  the  previously  noted  equivalence  between  noise  response  and 
robustness,  this  implies  that  at  the  point  where  the  noise  is  introduced,  the 
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.  oV  istness  properties  of  the  design  using  the  Kalman  filter  asymptotically 
-ippjon>  hes  the  robustness  properties  of  the  state  feedback  design.  The  num 
ber  of  points  where  th<  perturbations  or  noise  may  be  introduced  is  equal  to 
the  number  of  independent  measurements  available.  This  asymptotic  prop¬ 
erty  is  achieved  at  the  expense  of  poor  rejection  of  observation  noise,  and 
only  holds  for  systems  where  the  transfer  function  matrix  between  the  fic¬ 
titious  noise  processes  and  the  measurements  has  no  right-half  plane  zeroes 
The  trade-off  between  observation  noise  response  and  achievement  of  state 
feedback  properties  may  be  obtained  through  adjustment  of  the  parameter  q. 

This  approach  may  be  used  to  design  robust  controllers  using  a  modified 
LQG  methodology.  Here  fictitious  noise  may  be  added  in  the  Kalman  filter 
design  l  p  to  improve  the  robustness  properties  of  the  final  design.  Opti¬ 
mal  noise  rejection  may  then  be  traded  off  with  robustness.  Appendix  I 
presents  an  example  of  such  an  approach. 

This  methodology  applies  equally  well  to  observer  design.  Any  stable  ob¬ 
server  whose  gain  behaves  as  in  equation  (60)  will  have  the  desired  proper¬ 
ties.  The  Kalman  filter  framework  provides  a  convenient  approach  to 
observer  design. 

AN  ALTERNATE  METHOD  FOR  SELECTING  QUADRATIC  WEIGHTS 
BASED  ON  SINGU L An  VALUES 

Consider  the  L.Q  problem  for  the  system 

'•  -  \x  "Bn ,  x(0)  given  (63) 
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with  performance  index 


J  -  J  [  (Cx) 1  Cx  +  uTu]  dt  (64) 

o 

where  x  is  an  n-vector  and  u  is  an  m-vector.  The  optimal  control  is 

u  =  Fx  (65) 

with 

F  =  -BTP  (66) 

where  P  is  the  positive  definite  symmetric  solution  of 

CTC  =  PBBTP  -  PA  -  ATP  (67) 

This  is  equivalent  to  F  being  the  solution  of 

[I  +  G(juj )  ]  [I  +  G(juu)  ]  =  I  +  H  (j(u)H(jtu )  (68) 

where  G(jou)  =  F(jcul  -  A)  B  (69) 

and  H(ju>)  =  C(jcoI  -  A)_1B  (70) 

In  terms  of  singular  values,  equation  (68)  yields 

a2(I  +  G(ju)»  =  1  +  (H(jou))  (71) 
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This  gives  a  characterization  of  the  frequency  domain  properties  of  (I  +  G) 

T 

directly  in  terms  of  the  quadratic  weighting  matrix  C  C. 

If  one  is  given  desired  singular  values  of  (I  +  G(j<ju).  then  these  define 
desired  singular  values  of  H(j).  Suppose  that 


"  A  A 

Hd(j(JU)  =  UEV 


possesses  the  desired  singular  properties,  and  let  the  singular  values  de¬ 
composition  of  (jujl  -  A)  be 


-1  * 

(joul  -  A)  B  =  UEV 


Then  the  weighting  matrix  C  may  be  chosen  such  that  CUEV  approximates 
in  some  manner.  For  example,  select  C  to  minimize 

A  A  A 

||CUZV"  -  UZ  V  1 1  (74) 

where  all  terms  except  C  in  (74)  are  functions  of  frequency  uj.  With  C  so 
chosen,  the  Riccati  equation  (67)  may  be  solved  and  the  gain  matrix  obtained 
from  equation  (66).  The  choice  of  the  norm  to  be  used  in  (74)  that  yields 
good  closed-loop  properties  requires  further  investigation. 

Another  area  that  appears  to  be  worthy  of  future  research  is  based  on  the 
following  observation.  Suppose  that  in  equation  (63),  A  is  stable  with  the 
control  given  by  (65),  (66),  and  (67)  where  C  is  such  that 


T  T 

C  C  =  PBB  P  -  Q 
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with 


Q  2  0  (76) 

This  is  equivalent  to  the  condition  that 

PA  +  ATP  *  0  (77) 

In  this  case  the  controlled  system  has  what  is  called  integrity.  That  is,  if 
the  gain  of  any  actuator  or  set  of  actuators  is  reduced  or  even  becomes  zero, 
the  remaining  system  will  have  guaranteed  robustness  of  LQ  controllers. 
This  result  may  be  established  as  follows.  Let  D  be  a  diagonal  matrix  with 
elements  d.  satisfying 

0<d.<l  (78) 

and  set 

A 

B  =  BD  (79) 

Then  the  control  is 

A 

u  =  Fx  (80) 


with 


A  A 

F  =  -BP  =  DF 


(81) 
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This  control  is  optimal  with  respect  to  (64)  with  C  replaced  by  C  where 

A  T*  a  T  T 

C  C  =  PBDD  B  P  -  Q  (82) 

This  result  has  important  implications  for  robustness  of  feedback  systems 
for  open-loop  systems  that  are  stable,  and  further  research  is  recommended 
to  deal  with  open-loop  systems  that  are  unstable. 
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APPENDIX  A 


CHOOSING  QUADRATIC  WEIGHTS  TO  ACHIEVE 
DESIRED  ASYMPTOTIC  MODAL  PROPERTIES 
By  H.  R.  Sirisena 


ABSTRACT 

A  new  approach  to  the  characterization  of  quadratic  performance  indices 
in  terms  of  asymptotic  eigenvalues  and  eigenvectors  is  described.  The 
regular  case  where  precisely  n-m  eigenvalues  remain  finite  for  an  n-th 
order  m-input  system  is  first  treated.  It  is  shown  that  there  exists 
an  m-1  parameter  family  of  quadratic  performance  indices  that  yields 
any  desired  set  of  asymptotic  eigenvalues  and  eigenvectors.  A  solution 
is  also  obtained  for  the  two  leading  terms  in  the  asymptotic  expansion 
of  the  optimal  control  law. 

The  singular  case  where  more  than  n-m  asymptotic  eigenvalues  remain  finite 
is  treated  next.  It  turns  out  that  in  this  case  there  is  less  freedom 
in  specifying  the  asymptotic  modes  and  moreover  the  corresponding  quadratic 
performance  indices  are  characterized  by  nonlinear  equations  rather  than 
by  linear  equations  as  in  the  regular  case.  Hence  solutions  may  not  exist 
in  general,  and  in  any  case  are  difficult  to  obtain. 
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1.  Introduction 


Consider  the  n-th  order,  m-input  plant 

x  =  Fx  +  Gu  ( 1 ) 

associated  with  the  quadratic  performance  index 

J  =  /*  (x'Qx  +p  2u'  Ru ) dt 

where,  without  loss  of  generality  [l]  ,  it  is  assumed  that  Q  =  H'H, 

H  being  an  mxn  matrix.  A  study  of  the  asymptotic  modal  properties 

of  the  optimal  closed-loop  system  as  p-*- 0  £lj  ,  ^2j  reveals  that  three  cases 

can  be  distinguished. 

(i)  When  rank  (HG)  =  m,  n-m  eigenvalues  remain  finite  while  the 
remaining  m  eigenvalues  tend  to  infinity  in  m  first-order  Butterworth 
patterns. 

(ii)  When  rank  H  =  rank  G  =  m,  but  rank  ( HG ) <  m,  fewer  than  n-m  eigenvalues 
remain  finite  while  the  remaining  eigenvalues  tend  to  infinity  in 
multiple  Butterworth  patterns 

(iii)  When  rank  H<  m,  more  than  n-m  eigenvalues  may  remain  finite. 

Here  we  consider  the  inverse  problem  of  finding  weighting  matrices  Q 
and  R  such  that  the  optimal  system  possesses  prespecified  modal  pro¬ 
perties.  The  inverse  problem  corresponding  to  case  (i)  has  already  been 
studied  in  reference  £lj  ,  but  here  we  give  an  alternative  treatment  that 
also  yields  the  two  leading  terms  in  the  asymptotic  expansion  of  the 
optimal  control  law.  The  approach  adopted  also  enables  investigation 
of  the  inverse  problem  corresponding  to  case  (iii). 

2.  The  Case  Rank  (HG)  =  m 
Optimal  Control  Law 

The  optimal  state  feedback  law  K  is  given  by 

K  =  -p'Wp  (3) 

Where  P  is  the  symmetric  positive-definite  solution  of  the  algebraic 
Riccati  equation  (ARE) 

PF  +  F 1 P  -  p~^PGR-1G'P  +  Q  =  0  (4) 
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As  p  +  0,  P  can  be  expanded  in  a  power  series 

p  =  pPj  +  p2  P2  +  p3  P3  +  . . . 

where  the  matrices  P.  are  all  symmetric,  and  hence 
K  =  p'1K1  +  K2  +  pK3  +  ... 

where 

Ki  =  -  R"1G'Pi 

It  is  clear  that  the  asymptotic  properties  of  the  optimal  system  as 
p  ^0  are  governed  by  the  first  two  terms  in  the  expansion  (6). 

Asymptotically  Finite  Eigenvalues 

Let  (s.j  ,  x . ) ,  i  =  1,2...,  n-m  be  the  desired  finite  asymptotic 
eigenvalues  (assumed  to  be  distinct),  and  the  corresponding  eigenvectors 
respectively.  Then  we  have  that 
lim  (s  •  I-F-GK)x..  =0,  i  =  l,2,...,n-m 

p  -*■  0 

Plugging  in  (6),  it  follows  that 

lim  (s^.I-F-  p’1  GKj  -  GK^x^  =  0,  i  =  l,2,...,n-m 

p  -*-0 

Now  from  consideration  of  the  0(  p  *)  term,  it  is  evident  that 
GK^  x .  =  0,  i  =  1 ,2, . . .  ,n-m 
which  implies  that 

KjX.j  =0  i  =  1,2, . . .  ,n-m 
providing  G  has  full  rank  m. 

From  (9)  and  (10),  we  also  have  that 
(s.I-F-GK2)xi  =  0,  i  =  l,2,...,n-m 
which,  following  Moore  j^3 J  ,  can  be  rearranged  into  the  form 
x.j  =  (si  I-F)-1  GK2xi  *  (s.I-F)"1Gv1  ,  i  =  l,2,...,n-m 

where 

v i  =  K2xi  ’  1  = 

(12)  implies  that  once  si  is  specified,  the  corresponding  eigenvector 
x.  cannot  be  specified  arbitrarily  but  is  confined  to  an  m-dimensional 
subspace.  The  elements  of v ^  provide  m-1  independent  parameters  for 
the  specification  of  x^ . 


Asymptotically  Infinite  Eigenvalues 


From  (9)  it  is  clear  that  the  m  eigenvalues  that  tend  to  infinity  as  p+  0 
must  be  of  the  form  p  _1  s°°  ,  i  =  l,2,...,m  ,  where  the  s”  are  finite. 

Moreover, 

(p-1s“  I  -  P"1GK1)x“  =  0,  i  =  1,2,. ...m  (14) 

i.e.,  the  s*  and  x“  are  eigenvalue-eigenvector  pairsof  the  matrix 
GKj .  We  shall  assume  that  the  s“  are  non-zero  and  distinct. 


(14)  can  also  be  expressed  as  the  pair  of  equations 


=  G  v 


Klxi  = 


si 


) 

I 


i  =  1 .2, . . . ,m 


(15) 


oo 

(15)  implies  that  the  asymptotically  infinite  modes  x^  are  confined  to 
the  m-dimensional  range  space  of  G,  and  are  characterized  by  m-1  parameters 
(elements  of  v.  ). 


Evaluation  of  the  Control  Weighting  Matrix  R 


Defining  the  matrices 


[oo  oo 

S1  s2 


(15)  can  be  written  concisely  as 
X.  =  GN 
=  NS 

and  we  also  have  that 
KjG  =  NSN'1 


(16) 

(17) 

(18) 


Now  RK^G  =  G'P^G  must  be  symmetric  for  every  i.  Hence 
RKjG  =  RNSN'1  =  ( RNSN- 1 ) ' 

i.e.,  RNSN"1  =  ( N~ 1 ) ' SN ‘ R 

whence 


N’RNS  =  SN' RN 
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(19) 


which  in  turn  implies  that 
N’RN  =  r 

where  r  is  any  mxm  matrix  that  commutes  with  S, 

i .e.  r  S  =  S  r 

For  the  case  in  hand  where  S  has  distinct  non-zero  diagonal  elements,  p 
must  also  be  diagonal  though  otherwise  arbitrary.  Hence  from  (19), 

R  =  (N1)'1  TN"1  (20) 

where  r  is  any  arbitrary  diagonal  matrix.  Since  we  require  R  to 
be  positive  definite,  the  diagonal  elements  of  r  must  be  strictly 
positive. 


Evaluation  of  the  Matrices  Qj.K^  and  K2 


Using  (3),  the  ARE  (4)  can  also  be  written  as 
PF  +  F'P  -  d  k'rK  +  Q  =  0 

Substituting  the  power  series  expansions  of  P  and  K  into  (21)  and 

o 

equating  0(1),  0(  p)  and  0(  p  )  terms  on  the  LHS  to  zero  yields  the 
three  equations 

Q  -  K1’RK1  =  0 


PjF  +  F’Q1  -  Kj'RKg  -  K2'RK1  =  0 


p2f  +  f-p2 


ki,rk3 


-  K2'RK2  -  K3'RK1 


=  0 


Now  defining  the  matrices 


'1 


’f  = 


2 

v2 

X 


(n-m] 
n-m  ] 


(10)  and  (13)  may  be  written  as 
K1  Xf  =  0 

^2  Xf  - 

Then  from  (17)  and  (25)  we  obtain  that 


'1 


whence 


. 


0  NS 


] 


‘f  *-]  *  [ 

Ki  ■  [°  NS1  [xf 


Defini ng 


-I 


-1 


f 

Y 


X  n-m 

j  t  m 


(21) 


(22) 

(23) 

(24) 


(25) 

(26) 
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it  follows  that 

Kj  =  NSY.  (28) 

Clearly  the  matrices  Yf  and  Y*,  are  comprised  of  the  dual  eigenvectors  associated, 
respectively,  with  the  asymptotically  finite  and  asymptotically  infinite 
eigenvalues. 

Substituting  for  Kjand  R  in  (22),  we  obtain 

Q  =  K  '  S  rSY^  (29) 

It  only  remains  to  find  Now  1C,  is  already  partially  specified  by 
equation  (26).  To  complete  the  characterization  of K2  ,  multiply  (23)  on 
the  left  by  G'  and  on  the  right  by  G  to  obtain 

G'  P-|  FG  +  G'F'PjG  -  G'  Kj '  RK^G  -  G'^'RK^  =  0 
Substituting  for  P^  in  termsof  and  also  invoking  the  symmetry  of 
RK^G,  we  have  that 

G'Kj'  (RK2G)  +  (RK?G)  KjG  +  RKjFG  +  G'F'Kj'R  =  0  (30) 

Since  K^G  is  nonsingular  ,  this  Lyapunov  equation  has  a  unique 
solution  for  RIC,G,  say 

RK2G  =  Z  (31) 

From  (31)  and  (16),  we  obtain 

K2GN  =  K2X«,  =  R_1ZN  (32) 

and  finally  from  (26)  and  (32)  we  find  that 

K2  =  [Nf  R’lzN]  [xf  x°]  _1 

=  NfYf  +  R_1ZNYco  (33) 

Oi scussion 


In  view  of  the  arbitrariness  of  the  diagonal  matrix  r  ,  (20)  and  (29) 

do  not  uniquely  define  the  weighting  matrices  R  and  Q  that  yield 
optimal  systems  having  the  specified  asymptotic  modal  properties. 

We  also  note  that  although  Kj  is  independent  of  r  ,  K2  appears  to 
depend  on  the  choice  of  r  .  Hence  while  every  choice  of  r  results 
in  the  same  asymptotic  properties,  the  properties  of  the  optimal 
system  for  finite  p  do  depend  on  the  choice  of  r  .  Thus  there  remains 
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the  possibility  of  choosing  the  m-1  independent  parameters  in  r  so  as  to 
meet  subsidiary  design  objectives  while  preserving  the  desired  asymptotic 
modal  properties. 

It  is  interesting  to  note  that  in  view  of  equations  (9)  -  (11),  the 
feedback  law 

u  =  (  p  +  K^Jx  (34) 

results  in  the  (n-m)  eigenvalue  -  eigenvector  pairs  (S^  ,  )  , 

i  =  1,2,...,  n-m  being  invariant  with  respect  to  p  .  Thus  the 
'truncated'  control  law  (29),  which  is  asymptotically  equivalent  to 
the  true  optimal  control  law  Kx  ,  appears  to  possess  properties  that  may 
be  practically  useful. 


3.  The  Case  Rank  H  <  m 


Suppose  we  want  to  have  more  than  n-m  asymptotically  finite  eigenvalues, 
say,  sn-  ,  i  =  l,2,...,n-q  where  q<  m.  Suppose  also  that  we  want  the 
remaining  q  eigenvalues  to  tend  to  infinity  in  first-order  Butterworth 

—  1  oo 

patterns,  i.e.,  to  have  the  form  p  s^.  ,  i  =  1,2,  ....  q.  Then  the 

key  equations  (10)  -  (13)  and  (15)  assume  the  forms 


K1xi  =  0  ,  i 

(s.I  -  F  -  GK2)x.j=0,  i 

Xi  =  (s.I  -  F)"1  Gv.,  i 
00  ^  \ 


1,2,. . .  ,n-q 
1,2,...  ,n-q 
1,2,.. .  ,n-q 
1,2,. . .  ,q 


It  is  convenient  to  generalize  the  previous  notation  and  define 


(35) 

(36) 

(37) 

(38) 


! 


! 


I 
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Evaluation  of_K^  ,  R  and  Q 


As  before,  from  (35)  and  (38)  we  obtain 
K1  =  [°  NS][Xf  -]'1  =  NSY~ 


KjGN  =  NS 


(40) 

(41) 


(41)  implies  that  K.G  has  q  non-zero  eigenvalues  s-  with  corresponding 

GO  A 

eigenvectors  v..  From  (40)  it  is  clear  that  rank  Kj  =  q  ,  and  hence 
rank  (KjG)  =  q.  Thus  the  remaining  m-q  eigenvalues  of  K^G  are  zero. 

Let  M  denote  the  mx(m-q)  modal  matrix  associated  with  these  eigenvalues, 


i  .e. 


Then 


K.GM  =  0 


(42) 


KjG  =  [n  m] 


S  0 
0  0 


[n  r^1 


L  J  - 1 

To  obtain  R,  as  before  we  invoke  the  symmetry  of  RKG  (or  KGR  ). 

This  yields 


R 


-1 


[n  m  ]  I  r  0  j  [n  m]  ' 
0  0 


mj 

Where  r  is  an  arbitrary  q  x  q  diagonal  matrix  and  0  is  an  arbitrary 
(m-q)  x  (m-q)  symmetric  matrix,  whence 


R 


-1  _ 


N  r  N*  +  M0M1 


Then  from  (22)  we  have  that 
Q  =  Kj*  RKj 


(44) 

(45) 


Although  it  appears  from  (40),  (44)  and  (45)  that  the  inverse  problem 
has  been  solved  for  the  case  q  <m,  we  have  still  to  check  whether  the 
higher-order  terms  in  the  ARE  are  consistent  with  (40),  (44)  and  (45) 
(as  they  were  for  the  case  q  =  m). 

Consistency  Check  for  0(  p)  terms  in  ARE 

The  0  (  p)  terms  in  the  ARE  yield  (30)  which  can  be  transformed  tc  the 
form 
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1 


u  i\  ^  T  u  t  r\  u  r  t  n. 


This  equation  clearly  has  a  solution  of  the  form 

K-GR^G'Kj*  +  R  ^G'F'Kj'  =  V  (47) 

where  V  is  some  skew-symmetric  matrix. 

Plugging  (40)  into  (47),  it  is  evident  that  V  must  have  the  decomposition 

V  =  LN 1  (48) 

where  L  is  some  mxq  matrix  that  is  yet  to  be  determined.  Moreover 

the  skew  symmetry  of  V  implies  that 

LN'  +  NL '  =  0  (49) 

Now  the  multiplication  of  (47)  on  the  right  by  a  right  inverse  of 
N1  yields 

K-GR'Vy  'S  +  R_1G'F'Y  S  =  L  (50) 

/  CO  oo 

Substituting  of  R_1  in  the  first  form  of  (50),  we  find  that 

K2  [(GNTN'G  +  GM9M' G‘  )Y^  1  s]  =  L  R'Vf'Y^  '  S  (51) 

Now  using  the  relations  GN  =  from  (39),  Y^  =  1^  by  definition, 

and  the  fact  that 

K.GM  =  NSY  GM  =  0 

1  ® 

implies  that 

Y  GM  =  0  (52) 

oo 

since  N  has  full  rank,  equation  (51)  may  be  simplified  to 

LXr  S  =  L  -  R_1G'F'Y  1  S  (53) 

C.  oo  oo 

From  (38)  and  (53)  we  can  then  solve  for  K2  as 

K2  ■  [Nf  LS'1  r'1  -  R-'G’F'Y.r"1]  [xf  xj’1 

=  N,  Y,  +  ILS'1  -  R_1G,F‘ Y  ')  r*1  Y  (54) 

T  T  l  00  00 


Since  (49)  always  has  at  least  the  trivial  solution  L  =  0,  Kp  defined 
by  (54)  exists.  However  it  is  necessary  that 

k2gr-1  =  (k2gr_1) ' 

which  comprises  m(m-l)/2  constraints  to  be  satisfied  by  the  elements 
of  L  ,  r  and  9. 


(55) 


2 

Multiplication  of  the  0(p  )  equation  (24)  on  the  left  by  M'G'  and  on  the 
right  by  GM  yields 

M'RK2FGM  +  M 1 G '  F 1  K2 1  RM  +  M'G'^'R^GM  =  0 
where  we  have  used  the  equalities 

KjGM  =0  ,  G'P2  =  -RK2 

to  effect  a  simplification. 

(56)  represents  a  further  (m-q) (m-q+l)/2  equations  to  be  satisfied  by 
the  elements  of  L,  r  and  0. 

Necessary  Conditions  for  a  Solution 

We  first  consider  the  case 
mq  <  m(m+l)/2 

Then  clearly,  for  almost  all  N,  the  only  solution  of  (49)  will  be 
L  =  0.  Then  we  are  left  with  the  m(m-l)/2  +  (m-q) (m-q+l)/2  equations 
(55),  (56)  in  the  q  +  (m-q) (m-q+l)/2  elements  of  r  and  9  ,  and  a  solution 
will  exist  in  general  only  if 

q  >  m(m-l)/2 

From  (57)  and  (58),  it  follows  that  a  solution  may  exist  if 
m(m-l)/2  4  q  4  (m+l)/2 


We  next  consider  the  case 

mq  >  m(m  +  l)/2 

Now,  nontrivial  solutions  of  (49)  can  exist.  It  is  clear  that  a 
condition  for  the  existence  of  L,  r  and  9  satisfying  (49),  (55)  and 
(56)  is  that  mq  +  q  *  (m-q)(m-q  +  1 ) / 2  4  m(m  +  l)/2  +  m(m-l)/2 

+ (m-q) (m-q  +  l)/2 

2 

i .e.  q  >  m  /(m  +  1) 

Since  for  m41,  (60)  is  satisfied  whenever  (61)  is  satisfied,  we  have 
that  (61)  is  the  alternative  condition  to  (59)  for  the  existence  of  a 
sol ution. 


Now  the  only  integral  q  that  satisfies  (61)  for  m is  q  =  m,  Also, 
it  is  easy  to  show  that  the  only  case  with  q<  m  that  is  consistent  with 
(59)  is  q  =  1,  m  =  2.  Thus  we  conclude  that  q  =  1,  m  ==  2  represents  the 
only  case  where  eigenvalue  -  eigenvector  placement  may  he  achieved  with 
the  same  freedom  as  when  q  =  m. 

We  now  work  out  a  numerical  example  to  illustrate  this  case. 

Example  1 

Consider  a  plant  with 


r 

1 

~ 

1 

l 

1 

,  G  = 

1 

0 

2 

1 

0 

1 

Suppose  we  choose  the  asymptotical ly  finite  eigenvalue  to  be  s^  ==-1  , 
and  also  choose 


1 


1 

loj 


N., 


so  that  the  corresponding  eigenvector  is 

■1 


Xj  =  (Sj  I  -  FT1  G  vj 


l  1 ; 


Suppose  also  that  we  choose  s. 

~r  n  *  1 


■1  , 


1 


l] 


=  N 


so  that  the  eigenvector  associated  with  the  asymptotically  infinite 
eigenvalue  is 

roi 

X 


X1  *  Gvl 


Then  (40)  yields 
K1  = 


0  0 
0  -1 


J  L 


1 

o 

_ J 

-l 

o 

0 

1 

t 

i 

ii 

-1 

-1 
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Here  K^G  =  ,  and  hence  the  eigenvector  M  corresponding  to  the  zero 

eigenvalue  of  K^G  is  clearly 


T  1  ' 

M  =  -1 

-  J 

Then  from  (43), 


'o  r 

fy  01 

o 

» — * 

_ j 

,i  -i. 

a> 

o 

_ i 

U  -ij 

Since  any  scale  factor  in  R  can  be  absorbed  into  p  we  can  take  y  =  1 
which  gives 


R 


-1 


0  -9 

-0  9+1 


Next  we  find  that  the  solution  of  (49)  is 

'0 

L  = 

Hence  from  (54)  we  obtain  that 


n 


■  [-1  o]  _  | 

0  -01 

1 

r 

C\J 

T 

[>  *] 

-0  0+1 J 

J 

1 

.1  • 

-l  -  0 
9  -  2 


-0' 

0-2 


Equation  (55)  therefore  reduces  to 
(-1-0)  (-0)  +  (-0) (9+1)  =  (0  -2)  0  +  (0  -2) (-0) 

which  is  satisfied  trivially. 

Finally,  equation  (56)  simplifies  to 

16  0  3  -  20  Q2  +  39+1  =  0 
which  has  roots 

0  =  1  ,  (-1  +VT  )/8. 
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The  negative  root  can  be  rejected  since  R  must  be  positive  definite. 
Thus  we  have  two  solutions. 


The  root  0=1  corresponds  to 


i  .e. 


‘  1  -1 

-1  2 


R 

and 

Q 


2  l"j 

1  *J 


K-j  1  RKj 


1  !1 
1  lj 


Di scussion 


It  is  clear  from  the  analysis  of  this  section  that,  in  general,  solutions 
to  the  inverse  problem  when  q<  m  may  only  become  possible  by  relaxing 
the  requirement  for  eigenvector  placement.  That  is,  by  making  the 

and  v“  free  parameters  instead  of  fixing  them  at  the  onset.  Even 
then,  there  is  no  guarantee  that  a  solution  exists  because  the  equations 
defining  the  solution  are  nonlinear  unlike  in  the  q  =  m  case.  In  fact, 
it  is  not  even  clear  that  arbitrary  placement  of  just  the  asymptotic 
eigenvalues  can  be  achieved  in  general. 

The  above  conclusions  are  based  on  checking  the  consistency  of  terms 
only  up  to  0(  p  )  in  the  ARE.  Consideration  of  higher  order  terms  can 
only  yield  more  stringent  conditions  for  the  existence  of  a  solution. 

It  should  be  noted,  however,  that  if  the  above  consistency  checks  are 
satisfied,  then  the  control  law 

u  =  1p"^I<i  +  K^)x 

yields  the  desired  asymptotic  modal  properties,  although  this  control 
law  may  not  correspond  to  the  leading  terms  of  an  optimal  control  law. 


52 


References 


1  C.  A.  Harvey,  G.  Stein,  and  J.  C.  Doyle,  "Optimal 
Linear  Control  (Characterization  of  Multi-Input 
Systems),"  Honeywell  report  for  the  Office  of  Naval 
Research,  ONR  CR215-238-2,  July  1977 

2  H.  Kwakernaak ,  "Asymptotic  Root  Loci  of  Multivariable 
Linear  Optimal  Regulators".  IEEE  Trans.  Automat. 
Contr.  Vol .  AC-21,  pp  378-382,  June  1976. 

3  B.  C.  Moore,  "On  the  Flexibility  Offered  by  State 
Feedback  in  Multivariable  Systems  Beyond  Closed 
Loop  Eigenvalue  Assignment,"  IEEE  Trans.  Automat. 
Contr.,  Vol.  AC-21,  pp.  689-691,  Oct.  1976 


53 


APPENDIX  B 

CHARACTERISTICS  OF  OPTIMAL 
LINEAR  REGULATORS  WITH  SMALL 
CONTROL  WEIGHTS 


55 


APPENDIX  B 

CHARACTERISTICS  OF  OPTIMAL 
LINEAR  REGULATORS  WITH  SMALL 
CONTROL  WEIGHTS 
By  h.  R.  Sirisena 


ABSTRACT 

A  method  is  developed  for  finding  the  leading  terms  in  an  asymptotic 
expansion  of  the  optimal  control  law  for  small  weights  on  the  controls. 

The  corresponding  expansions  for  the  eigenvalues  and  eigenvectors  of  the 
optimal  system  are  also  obtained. 

I.  INTRODUCTION 

Given  the  nth  order,  m-input  system 

X  =  Fx  +  Gu  (1) 

and  the  performance  index 

“  o 

J  =  /  ( x ’ Qx  +  p^u ' Ru)  dt  ,  (2) 

o 

Reference  1  examines  the  asymptotic  behavior  of  the  optimal  closed-loop 
eigenvalues  as  the  scalar  p  tends  to  zero.  References  2  and  3  consider  also 
the  asymptotic  behavior  of  the  eigenvectors,  though  they  are  primarily  con¬ 
cerned  with  the  inverse  problem  of  choosing  Q  and  R  to  achieve  specified 
asymptotic  eigenvalues  and  eigenvectors. 

Here  we  treat  the  direct  problem,  our  main  objective  being  to  determine 
the  leading  terms  in  the  expansion  of  the  optimal  control  law  as  a  power 
series  in  p.  The  behavior  of  the  eigenvalues  and  eigenvectors  for  small 
but  finite  values  of  p  may  thereby  be  investigated. 
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1 


2. 


PRLLIMINARY  RESULTS 


Without  loss  of  generality,  Reference  2,  we  assume  that 

Q  =  H'H  (3) 

where  H  is  an  mxn  matrix  such  that  the  system  (F,  G,  H)  is  observable  and 
minimum  phase. 

It  is  well  known  that  the  optimal  control  law  is  given  by 

K  =  -p'2  P’1  G'  P  (4) 

where  P  is  the  solution  of  the  Algebraic  Riccati  Equation  (ARE) 

PF  +  F'P  -  p"2  PGR-1  G'P  +  H'H  =  0  (5) 

The  matrix  P  is  symmetric  and  positive  definite,  and  admits  the  power  series 


expansion 

P  =  P pi  +  p 2P2  +  p 3p3  +  • • •  (6) 

where  the  matrices  P ■  are  also  symmetric. 

Similarly  K  admits  the  power  series  expansion 

K  =  p'1  Kj  +  K2  +  p  K3  +  ...  (7) 

where 

^  =  -R'1  G1  P.  (8) 

Plugging  (6)  into  (5)  and  using  (8),  it  is  easy  to  show,  Reference  3,  that 
K  '  R  Kj  =  H '  H  (9) 

PjF  +  F'Pj  -  Kj,RK2  -  K2'RK1  *  0  (10) 

P2F  +  F'P2  -  Kj'RK3  -  K2'RK2  -  K3'RKj  =  0  (11) 

3.  THE  CASE  RANK  HG  =  M 


We  distinguish  between  this  case  and  the  case  where  HG  is  of  less  than  full 
rank  because  the  two  cases  correspond  to  quite  different  asymptotic  properties. 
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3.1  De termination  of  K ^ 


Premultiplying  (9)  by  G1  and  postmul tiplying  by  G,  we  obtain 


G'Kj'RKjG  =  G'H'HG 

(12) 

Since  RKjG  is  symmetric,  (12)  can  be  rearranged  as 

G'Kj'G'Kj'R  =  G'H'HG 

(13) 

whence 

(G*  K1 ' )2  =  G'H'HGR-1 

(14) 

Now  it  can  be  shown  that  the  product  of  two  symmetric  positive  definite 
matrices  has  eigenvalues  that  are  real  and  strictly  positive.  Thus  the 
quantity  on  the  RHS  of  (14)  has  real  square  roots,  and  we  can  write 

G'Kj'  =  (G'H'HGR-1) ^ 

(15) 

where  the  subscript  '_'  denotes  that  the  square  root  having  all 
eigenvalues  negative  is  chosen,  since  it  is  known , (Reference  3) 
eigenvalues  of  KjG  are  all  negative. 

its 

that  the 

Premultiplying  (9)  by  G',  we  have 

G'Kj'RKj  =  G'H'H 

(16) 

then  plugging  (15)  into  (16)  and  solving  for  K^,  we  obtain 

Kj  =  R-1  (G'H'HGR-1)**  G'H'H 

(17) 

3.2  Determination  of  K0 

On  premultiplying  (10)  by  G'  and  postmul tiplying  by  G  we  obtain 
G'PjFG  +  G'F'PjG  -  G'Kj'RKgG  -  G'Kj'RKjG  =  0 
which  reduces  to 

G'K1'(RK2G)  +  (RK2G)K1G  +  RKjFG  +  G’F'Kj’R  =  0  (18) 

on  using  the  relations  G'Pj  =  -RKj  and  (RKgG)'  =  RK2G.  Since  KjG  is 
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nonsingular,  the  Lyapunov  equation  (18)  has  a  unique  solution,  say. 


RK2G  =  Z 


Next  we  note  the  fact  that  (Reference  4) 

P  =  -K.'R  (RK^G)”1  RKi  +  (20) 

is  the  most  general  that  satisfies  (3);  where  is  any  nxn  symmetric 
matrix  that  satisfies 

i^G  =  0  (21) 

A  little  thought  shows  that  the  most  general  form  of  P^  is 

-  G0'LjG0  (22) 

where  L.  is  any  (n-m)  x  (n-m)  symmetric  matrix,  and  Gq  is  an  (n-m)  x  n 
anihilator  of  G. 


Since  Kj  is  known,  P^  is  partially  characterized  by  (20)  and  (22),  i.e., 
we  may  write 

P1  ■  pl  +  G0'4G0  (23> 

where 

P}  =  -Kj'R  (RKjGf1  RKj  (24) 

and  is  an  (n-m)  x  (n-m)  symmetric  matrix  that  is  as  yet  undetermined. 


Now  premultiplying  (10)  by  G1,  and  then  plugging  in  (19)  and  (23),  we  get 

-RK.F  +  G'F'P.  +  G'F'G  ' L. G„  -  G'K.'RK,  -  ZK.  =  0 

1  1  olo  12  1 

which  can  be  solved  for  to  yield 


K2  A2L1Go  +  B2 


where 


A2  =  (RKjG)'1  G'F,G0' 

B2  =  (RK^)"1  {^G'F’Pj  -  RKjF  -  ZKj  J 


he 


We  now  only  need  to  find  Lj .  This  may  be  done  by  plugging  (23)  and  (25) 
into  (10)  which  yields 

«YGo'LlGo>F  *  F'<VGo'LlGo>  -  KTR(A2LlGotB2>  - 

(g0'liA2,+  B2')RK1  =  0  (28) 

On  premul tiplying  (28)  by  G+'  and  postmul tiplying  by  G+,  where  G*  is  a  right 
inverse  of  GQ,  we  obtain  the  following  Lyapunov  equation  for 

L.(G  FG+  -  A  'RK,G+)  +  (G+'F'G  '  -  G+l K. ' RA„)L,  + 
l  oo  2  1  o  o  o  ol  21 

Go'  (PiF+F'  Pi  -  Kj'RB^'RK^gJ  =  o  (29) 

Once  is  determined  by  solving  (29),  is  obtained  by  substituting  for 

Lj  in  (25). 

The  next  coefficient  matrix  can  be  obtained  from  equation  (11)  by  methods 

similar  to  those  outlined  above.  Similarly  K. ,  Kr,  etc,  can  be  obtained  from 

3  4  ™  ^ 

the  equations  arising  from  the  0(p  ),  0(p  ),  ...  etc  terms  in  the  ARE  (5). 

3.3  Asymptotic  Behavior  of  Eigenvalues  and  Eigenvectors 

We  now  examine  the  asymptotic  behavior  of  the  eigenvalues  and  eigenvectors  of 
the  closed-loop  matrix 

F  +  p"1  GKj  +  GK2  +  pGK3  +  . . .  (30) 

as  p  -*■  0.  Previous  work  (References  2  and  3)  has  shown  that  m  eigenvalues 
tend  to  eigenvalues  of  p"^K^G  (i.e.,  the  non-zero  eigenvalues  of  p’^GK^), 
while  the  remaining  n-m  eigenvalues  tend  to  the  finite  eigenvalues  of 
F  +  p^GKj  +  GK2. 

The  positions  of  the  asymptotically  infinite  eigenvalues  for  small  but  finite 
values  of  p  may  be  determined  by  treating  F  +  GK2  +  GK3  +  ...  to  be  a 
perturbation  of  the  matrix  p'^GK^.  Similarly,  the  locations  of  the  asymptotically 
finite  eigenvalues  may  be  investigated  by  considering  the  perturbation 
pGK^  +  ...  of  the  matrix  F  +  p~*GKj  +  G«2. 
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3.3.1  Asymptotically  Infinite  Eigenvalues 

We  first  need  to  determine  the  matrix  of  eigenvectors  of  GK^.  Now  if  K^G  has  the 
decomposition 

K.G  =  NSN'1  (31) 

where  S  =  diag  (Sj  ,  . . .  Sm  ) ,  then 

GKjGN  =  GNS 

Hence  the  modal  matrix  associated  with  the  nonzero  eigenvalues  of  GK^  is  GN. 

From  the  expression  (17)  for  Kp  it  is  clear  that  any  nx  (n-m)  anihilator  H° 
of  H  is  also  an  anihilator  of  Kj .  Hence  H°  qualifies  as  a  modal  matrix  for 
the  zero  eigenvalues  of  GK^. 

Now  it  is  easy  to  verify  that 

[gN  H°]  _1  = 

where  G°  is  the  (n-m)  x  n  anihilator  of  G  that  satisfies 

G°H°  =  I  (33) 

Hence  the  rows  of  the  matrix  on  the  RHS  of  (32)  are  the  dual  eigenvectors 
of  GKj . 

Finally,  we  apply  the  following  standard  formulas  (Reference  4)  for  perturba¬ 
tions  of  eigenvalues  and  eigenvectors  of  a  nxn  matrix  A  due  to  a  small 
perturbation  <$A 


6A.  =  vi 6  Aui 

(34) 

n 

— 

6  A .  =  2 

j=l 

(v  j  6  Au.)/(A.  -Aj) 

u  . 

J 

(35) 

J7i 

Where  Aj,  j  =  1,2,. ..,n  are  the  eigenvalues  of  A  and  u-,v.,  j  =  1,2,. ..,n 

J  J 

are  an  orthonormal  set  of  eigenvectors  and  dual  eigenvectors  of  A.  We  have 
that  the  perturbation  5s  T  of  the  eigenvalue  sT  of  GKj  is  given  by 

6s?  =  p(NS):1  Kj  (F+GK2)  Gvi  (36) 


(NS)-1  Ki 


(32) 
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where  (NS).1  denotes  the  i-th  row  of  (NS)'1  and  denotes  the  i-th  column 
of  N.  Hence  the  two  leading  terms  in  the  power  series  expansion  of  the 
asymptotically  infinite  eigenvalues  are 

P'1 s*  +  (NS)T1  K1  (F  +  GK2)  GVi  (37) 

We  also  have  that  the  perturbations  in  the  corresponding  eigenvectors  x(  are 


0  Q 

where  Hj  denotes  the  j-th  column  of  H  . 
3.3.2  Asymptotically  Finite  Eigenvalues 


In  Reference  3  it  is  shown  that  the  asymptotically  finite  eigenvalues  are 
the  n-m  eigenvalues  s^,  i  =  l,2,...,n-m  of  the  matrix  F  +p"1G«1  +  GK2 
that  are  associated  with  eigenvectors  x^  that  lie  in  the  kernel  of  Kj ,  i.e. 
are  such  that 

Klxj  =  0  ,  i  =  1 ,2, . . . ,n-m  (39) 

The  remaining  m  eigenvalues  are  of  course  asymptotically  associated  with  the 
eigenvectors  x®,  i  r  l,2,...,m. 


The  dual  eigenvectors  y^ ,  i  =  1,2,. ...n-m  associated  with  the  asymptotically 
finite  eigenvalues  s^  are  thus  given  by 


[Ki  *; 


00  „oo 
X  _  X.  X„ 

n-m  1  i 


®1  • 
n  J  i 


-1 


2  n-m  i  c  m. 

where  the  subscript  i  denotes  "i-th  row  of". 


(40) 


Then  applying  the  formula  (34)  we  find  that  the  perturbation  in  s..  is  given 
by 

5si  =  py.GK3x.,  i  =  1,2,. ...n-m  (41) 


Similarly,  the  perturbations  in  the  corresponding  eigenvectors  may  be  found 
by  applying  equation  (35). 


. 
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4.  THE  CASE  RANK  HG<M 

We  consider  only  the  case:  rank  H  =  rank  HG<M. 

4 . 1  Determination  of 

The  analysis  of  Section  3.1  holds  up  to  equation  (16)  but  the  matrix  inverse 
in  the  expression  (17)  for  evaluating  does  not  exist.  However,  this 
difficulty  can  be  circumvented  as  follows. 

Let  G'Kj  ,  given  by  (15),  have  the  decomposition 

G'K^  =  LM  (42) 

where  L,M  are  mxq  and  qxm  matrices  respectively,  where  q  =  rank  G'Kj.  It  is 
then  clear  that  K^  can  be  decomposed  as 

Kj  =  M'T  (43) 

since  G  has  full  rank. 

Now  plugging  (42)  and  (43)  into  (16),  we  have  that 
LMRM'T  =  G'H'H 

whence  we  obtain 

T  =  (MRM,)'1L+G,H'H 

where  L+  is  a  left  inverse  of  L.  Hence 
Kj  =  M'  (MRM* ) ~ 1 L+G 1 H' H 

4.2  Determination  of  K,, 

Finding  is  much  more  complicated  than  when  rank  HG  =  m,  and  no  general 
procedure  has  been  devised.  Essentially,  one  has  to  solve  the  simultaneous 
nonlinear  equations  (8),  (10)  and  (11)  while  invoking  the  symmetry  of  the  P^. 
The  steps  involved  are  best  illustrated  by  means  of  an  example. 


(44) 

(45) 


| 

I 
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.  I 
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Example  1 


Consider 

0  1 

F  =  ,  G  =  I,  H  = 

0  0 

First,  by  evaluating  (39),  we  obtain  that 

„  _  f-i/  vfT  -i/  n/T 

ki 

-1/  'TT  -i/  vJT 


R 


i  . 


Then  from  (8)  we  find  that  P1  =  -K^ .  Also,  K2  is  symmetric  since  ?2  is 

symmetric.  Therefore  let 

r*  ,i 


Then  equation  (10)  can  be  written 


"o  l/JT 

-f 

0  0 

i//T 

i  iff 

x  y 

_0  1  /f2_ 

J/{2  1/  >/~2_ 

_1/{T 

1  iff. 

J  z- 

f*  y] 

’i/JT  i/JT 

_ l 

i /{T  i/4T 

This  yields  the  equations 

x  +  y  =  0  (i) 

x  +  2y  +  z  =  1  (ii) 
y  +  z  =  1  (iii) 

of  which  only  two  are  linearly  independent. 

Next  we  consider  equation  (11)  which  we  multiply  on  the  left  by  £l  -1 
an  anihilator  of  Kj ,  and  on  the  right  by  [>  ->]  to  obtain 
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8  x  +  8  x  t  1  =  0 

(iv) 

where  we  have  used  the  fact 

that  P2 

Solving  ( iv) ,  we  get 

x  =  (-2  +  v/T)/4 

(v) 

whence  from  (i)  and  (iii) 

y  =  (2-  >/T)/4 

(vi) 

z  =  (2+  sjl)/ 4 

(vii 

To  select  the  correct  sign,  we  note  that  the  asymptotically  finite  eigenvalue, 
which  is  the  eigenvalue  of  F  +  GK2  whose  associated  eigenvector  lies  in  the 
kernel  of  is 

Sj  =  -1  -  2x  =  *  1/JT 

Thus  on  the  basis  of  stability,  we  choose  the  +  signs  in  (v)  and  (vii)  and 
hence  the  -  sign  in  (vi),  so  that  we  have  that 

~(-2  +  /2)/4  (2-^2)/4 

2  (2  -  /T)/4  (2+</2)/4_ 

Asymptotic  Behavior  of  Eigenviilu  s  and  Eigenvectors 

Once  Kj  and  K2  have  been  determined,  the  asymptotic  behavior  of  eigenvalues 
and  eigenvectors  may  be  analyzed  in  much  the  same  way  as  in  Section  3.3.  The 
main  difference  is  that  equation  (32)  no  longer  applies.  Hence  (36)  becomes 

6s*  =p[gNh°J:1  (F  +  GK2)  Gv.  (46) 

where  is  now  the  modal  matrix  associated  w.th  only  the  non-zero  eigenvalues 
of  KjG.  A  similar  modification  has  to  be  made  in  equation  (38). 
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In  the  case  of  the  asymptotical  1 y  finite  eigenvalues,  equation  (41)  continues 
to  apply  except  that  equation  (40)  defining  y..  must  be  modified  to  reflect 
the  fact  that  there  are  now  fewer  than  m  infinite  eigenvalues. 


5.  CONCLUSION 


Given  a  system  and  an  associated  quadratic  performance  index,  a  method  has 
been  developed  for  finding  the  leading  terms  in  an  asymptotic  expansion  of 
the  optimal  control  law.  The  asymptotic  behavior  of  the  eigenvalues  and 
eigenvectors  of  the  optimal  system  are  thereby  partially  characterized.  The 
results  are  less  than  general  in  that  the  case  rank  H  =  m,  rank  HG<  m  has 
not  been  treated. 
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APPENDIX  C 

GUARANTEED  MARGINS  FOR  LQG  REGULATORS 
By  John  C.  Doyle 


INTRODUCTION 


Considerable  attention  has  been  given  lately  to  the  issue  of  robustness 
of  linear-quadratic  (LQ)  regulators.  The  recent  work  by  Safonov  and 
Athans  j^lj  has  extended  to  the  multivariable  case  the  now  well-known 
guarantee  of  60°  phase  and  6  db  gain  margin  for  such  controllers. 
However,  for  even  the  single-input,  single-output  case  there  has 
remained  the  question  of  whether  there  exist  any  guaranteed  margins 
for  the  full  LQG  (Kalman  filter  in  the  loop)  regulator.  By  counter¬ 
example,  this  memo  answers  that  question;  there  are  none. 
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A  standard  two-state  single- input  single-output  LQG  control  problem  is 
po^ea  for  which  the  resulting  closed-loop  regulator  has  arbitrarily  small 
gain  margin. 


EXAMPLE 


Consider  the  following: 


where  (x^^),  u,  and  y  denote  the  usual  states,  control  input  and  measured 
output,  and  where  w  and  v  are  Gaussian  white  noises  with  intensities  o  >  0 
and  1 ,  respectively. 


Let  performance  integral  have  weights 


and  R  =  1 


Note  that  the  estimation  and  control  problems  have  identical  (dual)  solution 
matrices. 
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It  can  be  shown  analytically  that  the  optimal  gain  vector  g  in  u  =  -g'x 
be  written  as  a  function  of  q  as 


g 


2  +  V4  +  q  " 

1 


A  similar  relation  holds  between  the  optimal  filter  gain  k  and  o. 
simplicity,  let 


For 


where  f  =  2  +  V  4  +  q  and  d  -  2  +  V4  +  o 


Suppose  that  the  resulting  closed-loop  controller  has  a  scalar  gain 
m  (nominally  unity)  associated  with  the  input  matrix.  Only  the  nominal 

value  of  this  gain  is  known  to  the  filter.  The  full  system  matrix  then 
becomes 


'  1  1  0  0  - 

0  1  -mf  -mf 

d  0  1-d  1 

-d  0  -d-f  1-f. 

Evaluation  of  the  characteristic  polynomial  is  rather  tedious  but  reveals 
that  only  the  last  two  terms  are  functions  of  m.  The  linear  term  is 

d  +  f  -4  +  2(m-l )df 

and  the  constant  term  is 

1  +  (l-m)df. 

A  necessary  condition  for  stability  is  that  both  terms  be  positive. 

It  is  easy  to  see  that  for  sufficiently  large  d  and  f  (or  q  and  a), 
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may 


the  system  is  unstable  for  arbitrarily  small  perturbations  in  m  in 
either  direction.  Thus,  by  choice  of  q  and  o  the  gain  margins  may  be 
made  arbitrarily  small. 


It  is  interesting  to  note  that  the  margins  deteriorate  as  control 
weight  gets  small  and/or  system  driving  noise  gets  large.  In  modern 
control  folklore,  these  have  often  been  considered  ad  hoc  means  of 
improving  sensitivity. 

It  is  also  important  to  recognize  that  vanishing  margins  are  not  only 
associated  with  open  loop  unstaDle  systems.  It  is  easy  to  construct 
minimum  phase,  open  loop  stable  counterexamples  for  which  the  margins  are 
arbi trari ly  small . 

The  point  of  these  examples  is  that  LQG  solutions,  unlike  LQ  solutions, 
provide  no  global  system  -  independent  guaranteed  robustness  properties. 
Like  their  more  classical  colleagues,  modern  LQG  designers  are  obliged 
to  test  their  margins  for  each  specific  design. 

It  may,  however,  be  possible  to  improve  the  robustness  of  a  given  design 
by  relaxing  the  optimality  of  the  filter  with  respect  to  error  properties 
A  promising  approach  appears  to  be  the  introduction  of  certain  fictitious 
system  noises  in  the  filter  design  procedure.  This  approach  will  be  the 
topic  of  future  papers. 
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APPENDIX  D 


CHARACTERIZATION  OF  UNCERTAINTY 


An  important  aspect  of  the  total  system  design  procedure  is  the 
characterization  of  the  uncertainty  associated  with  using  a  model  for  a 
physical  plant.  A  design  model  must  extract  the  important  features  of  the 
plant  but  it  is  neither  possible  nor  desirable  to  represent  the  plant  in 
its  full  complexity. 

However,  when  the  model  is  being  used  for  feedback  design,  it  is  important 
to  have  some  knowledge  of  the  possible  differences  between  the  actual 
plant  upon  which  the  controller  must  operate  and  the  model  used  in  the 
design  stage.  These  differences  arise  from  parameter  variations,  unmodelled 
dynamics,  and  approximations  due  to  lumping  and  linearization.  (This  paper 
does  not  treat  uncertainty  due  to  disturbances  or  noise.)  The  nature  of 
the  uncertainty  will  dictate  how  feedback  will  be  used  to  reduce  that 
uncertainty. 

In  practice,  the  engineer  must  rely  heavily  on  physical  intuition  and 
experience  to  determine  the  nature  of  uncertainty,  as  well  as  the  recom¬ 
mendations  of  other  engineers  perhaps  more  intimately  familiar  with  the 
process  to  be  controlled.  However,  certain  features  of  physical  systems 
seem  to  be  fairly  universal  leading  to  certain  common  characteristics  of 
uncertainty  when  the  model  is  linear: 

1.  The  uncertainty  grows  with  increasing  frequency  due  to  unmodelled  high 

frequency  dynamics,  lumping  and  linearization  of  nonlinear  components. 

This  is  embodied  in  the  familiar  notion  of  a  "model  being  good  out  to 

frequency  u0-" 
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2.  A  particular  aspect  of  this  growth  in  uncertainty  is  that  phase  becomes 
totally  unknown  beyond  some  frequency.  This  is  a  critical  limitation  on 
the  bandwidth  of  the  feedback  design. 

3.  Actuators  tend  to  have  significant  nonlinearities  due  to  rate  and 
magnitude  limits  and  dead  bands.  The  linear  models  used  for  such 
actuators  will  be  entirely  inadequate  when  the  actuators  are  driven 
too  hard.  This  places  further  restrictions  on  loop  bandwidth. 

4.  Some  subsystems  may  be  very  accurately  modelled  by  linear  systems 
with  parameter  uncertainty.  The  parameter  variations  may  be  unknown 
but  may  be  bounded  or  have  some  probability  distribution  associated 
with  them.  If  these  variations  are  regular  and  identifiable,  some 

form  of  an  adaptive  scheme  may  be  called  for.  In  any  case,  a  controller 
must  be  insensitive  or  robust  with  respect  to  such  variations. 

5.  Quite  often  there  is  uncertainty  which  cannot  be  attributed  directly 

to  any  particular  parameter  variation  or  specific  modelling  assumption. 
This  can  occur  when  frequency  response  data  is  used  to  derive  models  or 
when  the  exact  physics  of  a  process  is  poorly  understood  (for  whatever 
reason).  Although  only  a  crude  model  may  be  available,  it  is  often 
possible  to  accurately  bound  the  total  uncertainty  of  the  input/output 
properties  of  such  systems  by  envelopes  of  transfer  functions. 

Ideally,  a  scheme  for  the  characterization  of  uncertainty  should  provide 

the  engineer  with: 

1.  A  capability  for  dealing  with  information  in  the  forms  indicated 
above  with  all  its  vagueness. 
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2.  A  capability  to  exploit  and  blend  the  computational  power  of  the 
computer  with  the  pattern  recognition  and  intuitive  capability  of 
the  human. 


3.  A  capability  to  use  precise  data  on  parameter  variations  when  available 


4.  A  set  of  tools  for  characterization  of  uncertainty  which  form  a 
natural  part  of  the  total  set  used  for  the  entire  modelling  and  design 
effort. 

5.  A  means  of  representing  the  system  which  extracts  the  essential 
features  necessary  for  feedback  design. 


6.  Tools  which  provide  insight  into  system  behavior. 

7.  Tools  which  are  reliable  in  that  they  neither  neglect  any  important 
sources  of  uncertainty  nor  lead  to  overly  conservative  designs. 


For  single  input/single  output  systems,  the  usual  techniques  of  classical 
and  modern  control  have  proven  fairly  adequate.  Of  particular  value  are 
the  frequency  domain  techniques  involving  Bode,  Nyquist,  and  Nichols  charts 

The  generalization  of  these  techniques  appropriate  to  multiloop  feedback 
systems  appears  to  involve  the  use  of  singular  valves. 
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ROBUSTNESS  OF  MULTILOOP  LINEAR 
FEEDBACK  SYSTEMS 
BY  J.C.  Doyle 


I.  INTRODUCTION 


A  critical  property  of  feedback  systems  is  their  robustness;  that  is,  their 
ability  to  maintain  performance  in  the  face  of  uncertainties.  In  particular, 
it  is  important  that  a  closed-loop  system  remain  stable  despite  differences 
between  the  model  used  for  design  and  the  actual  plant.  These  differences 
result  from  variations  in  modelled  parameters  as  well  as  plant  elements 
which  are  either  approximated,  aggregated,  or  ignored  in  the  design  model. 

The  robustness  requirements  of  a  linear  feedback  design  are  often  specified 
in  terms  of  desired  gain  and  phase  margins  and  bandwidth  limitations 
associated  with  loops  broken  at  the  input  to  the  plant  actuators  ([l]» 

[2J ) .  These  specifications  reflect  in  part  the  classical  notion  of  design¬ 
ing  controllers  which  are  adequate  for  a  set  of  plants  constituting  a 
frequency-domain  envelope  of  transfer  functions  [3].  The  bandwidth  limita¬ 
tion  provides  insurance  against  the  uncertainty  which  grows  with  frequency 
due  to  unmodelled  or  aggregated  high  frequency  dynamics. 

The  Nyquist  or  Inverse  Nyquist  diagram  (polar  plots  of  the  loop  transfer 
function)  provides  a  means  of  assessing  stability  and  robustness  at  a 
glance.  For  multiloop  systems,  scalar  Nyquist  diagrams  may  be  constructed 
for  each  loop  individually  providing  some  measure  of  robustness.  Unfortun¬ 
ately,  the  method  may  ignore  variations  which  simultaneously  affect  multiple 
loops. 


There  are  a  number  of  other  possible  ways  to  extend  the  classical 
frequency-domain  techniques.  One  involves  using  compensation  or 
feedback  to  decouple  (or  approximately  decouple)  a  multiloop  system 
into  a  set  of  scalar  systems  which  may  be  treated  with  scalar 
techniques  (i.e.,  "Diagonal  Dominance",  Rosenbock  [4]  ).  Another 
method  uses  the  eigenvalues  of  the  loop  transfer  matrix  (G(s)  in 
Figure  1)  as  a  function  of  frequency  (i.e.,  "Characteristic  Loci", 
MacFai lane,  et.  al.  f 5j  ,  [6l  ).  While  these  methods  provide 
legitimate  tools  for  dealing  with  multivariable  systems,  they  can 
lead  to  highly  optimistic  conclusions  about  the  robustness  of 
multiloop  feedback  designs.  Examples  in  Section  III  will  demonstrate 
this. 

This  paper  develops  an  alternative  view  of  multiloop  feedback 
systems  which  exploits  the  concepts  of  singular  values,  singular 
vectors,  and  the  spectral  norm  of  a  matrix.  (  [7i  -  fioj  ).  This 
approach  leads  to  a  reliable  method  for  analyzing  the  robustness 
of  multivariable  systems. 

Section  II  presents  a  basic  theorem  on  robustness  and  sensitivity 
properties  of  linear  multiloop  feedback  systems.  Multivariable 
generalizations  of  the  scalar  Nyquist,  Inverse  Nyquist  and  Bode 
analysis  methods  are  then  developed  from  this  same  result. 

Two  simple  examples  are  analyzed  in  Section  III  using  the  tools 
of  Section  II.  As  promised,  the  inadequacies  of  the  existing 
approaches  outlined  earlier  will  be  made  clear. 

Section  IV  contains  a  discussion  of  some  of  the  implications  of 


The  goal  of  this  paper  is  to  focus  on  the  analysis  of  robustness 
and  sensitivity  aspects  of  linear  multiloop  feedback  systems. 

Some  new  approaches  emerge  which  yield  important  insignts  into 
their  behavior.  The  mathematical  aspects  of  these  topics  are 
fairly  mundane  at  best,  so  rigor  and  generality  are  almost  always 
sacrificed  for  simplicity. 

Prel iminaries  and  Definitions 


A  brief  discussion  of  singular  values  and  vectors  follows.  Although 
the  concepts  apply  more  generally,  only  square  matrices  will  be 
considered  in  this  paper.  A  more  thorough  discussion  of  these 
topics  may  be  found  in  [7]  -  [loj  . 

The  singular  values  a-  of  a  complex  n  x  n  matrix  A  are  the  non- 

negative  square  roots  of  the  eigenvalues  of  A  A  where  A  is  the 

★ 

conjugate  transpose  of  A.  Since  A  A  is  Hermitian,  its  eigenvalues 

★  ★ 

are  real.  The  (right)  eigenvectors  v^  of  A  A  and  r^  of  AA  are 
the  right  and  left  singular  vectors,  respectively,  of  A.  These 
may  be  chosen  such  that 

a1-ri  =  Av i  ,  i  =  1,  . . .  n 

(1) 

crj  <  a2  <  ■ ..  i 

and  the  {r . }  and  {v..}  form  orthonormal  sets  of  vectors. 

It  is  well  known  that 

A  =  R  L  V*  (2) 


BO 


. 


where  R  and  V  consist  of  the  left  and  right  singular  vectors, 
respectively,  and  £  =  diag.  ( a i ,  ...»  o())-  The  decomposition 
in  (2)  is  called  the  singular  value  decomposition. 

Denote 

a  (A)  =  min  | |Ax j  j  =  o,  (3) 

1 ix 1 1=1 

and 

a  (A)  =  M^=  j  ||Ax||  =  ||A||2  =  on  (4) 

where  ||xj|  *  (x*x)Js  and  ||*||2  is  the  spectral  norm. 


The  singular  values  are  important  in  that  they  characterize 
the  effect  that  A  has  as  a  mapping  on  the  magnitude  of  the 
vectors  x.  The  singular  values  also  give  a  measure  of  how 
"close"  A  is  to  being  singular  (in  a  parametric  sense).  In 
fact,  the  quantity 


is  known  as  the  condition  number  with  respect  to  inversion  |9|  . 
The  eigenvalues  of  A  do  not  in  general  give  such  information. 

If  x  is  an  eigenvalue  of  A,  then 

£  _<  |  X  |  <_  a 

and  it  is  possible  for  the  smallest  eigenvalue  to  be  much  larger 
than  a. 
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II.  BASIC  RESULTS 


Consider  identity  the  feedback  system  in  Fig.  2  where  G(s)  is  the  rational 
loop  transfer  matrix  and  L(s)  is  a  perturbation  matrix,  nominally  zero, 
which  represents  the  deviation  of  G(s)  from  the  true  plant.  While  this 
deviation  is  unknown,  there  is  usually  some  knowledge  as  to  its  size. 

A  reasonable  measure  of  robustness  for  a  feedback  system  is  the  magnitude 
of  the  otherwise  arbitrary  perturbation  which  may  be  tolerated  without 
instability.  The  following  theorem  characterizes  robustness  in  this  way. 

The  "magnitude"  of  L(s)  is  taken  to  be  the  spectral  norm.  Only  stable 
perturbations  are  considered  since  no  feedback  design  may  be  made  robust 
with  respect  to  arbitrary  unmodeled  unstable  poles. 

Robustness  theorem:  Consider  the  perturbed  system  in  Fig.  2  with  the  follow¬ 
ing  assumptions 

i)  G(s)  and  L(s)  are  nxn  rational  square  matrices, 

ii)  det  ( G ( s ) )  |  0 

iii)  L(s)  is  stable 

iv)  the  nominal  closed  loop  system 
H  =  G( I+G)"1 
is  stable. 

Under  these  assumptions  the  perturbed  system  is  stable  if 

a  (I  +  G ( s ) ~ 1 )  >  a  (L(s) )  (5) 

for  all  s  in  the  classical  Nyquist  D-contour  (defined  below) 

Proof: 

It  is  well  known  Ul  that  since  G  is  invertible 


82 


(6) 


-1  -1  '/'l  ( s ) 

det(H(s)  *)  =  det  (I  +  G(s)  )  = 


where  i|>  (s)  is  the  nominal  closed-loop  characteristic  polynomial  and  ^(s) 
is  the  transmission  zero  polynomial  of  G  jjlj  . 


For  the  perturbed  system 


det  (I  +  G(s)  1  +  L(s)) 


|P2(s) 

<^1(s)^3(s) 


(7) 


where  i^(s)  is  the  perturbed  closed-loop  characteristic  polynomial  and 
( s )  is  the  characteristic  polynomial  of  L(s). 

Let  D  be  a  large  contour  in  the  s-plane  consisting  of  the  imaginary  axis  from  -jR  to 
+jR,  together  with  a  semicircle  of  radius  R  in  the  right  half-plane.  The 

radius  R  is  chosen  large  enough  so  that  all  finite  roots  of  ^(s)  have 

magnitude  less  than  R. 

Let  the  contour  rQ  be  the  image  of  D  under  the  map  ^(s)  det  (I  +  G(s)’*). 

Since  H  is  stable,  it  follows  from  the  principle  of  the  argument  that  rQ 

will  not  encircle  the  origin. 


Define  the  map 


-1 


y(q,s)  =  ^(s)  det  (I  +  G(s)  +  qL(s)),  q  real 

and  let  y(q,s)  map  D  into  the  Contour  r(q)  for  fixed  q,  o<cj^l. 
y ( q , s )  may  be  written  as 

^1(s)^3(s)  +  qe^s)  +  ..  .  +  qn0n(s) 

,(q>s)  "  - 

^(q.s) 

U>3(s) 
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(8) 


The  map 


(9) 


Clearly,  since  r(o)  =  r  ,  it  does  not  encircle  the  origin.  Since  the  roots 
of  ipq  are  algebraic  functions  of  q,  they  are  continuous  in  q  |l 2J  .  Thus 
the  only  way  that  the  perturbed  contour  r(l)  can  encircle  the  origin  is  for 

det  (I  +  G(s)"1  +  qL( s ) )  =  0  (10) 


for  some  s  in  D  and  some  q  on  the  interval  o<_q<l.  (Recall  that  i^(s)  has 

no  riqht  half-plane  roots).  When  (10)  is  satisfied  then  o_  (I  +  G"1  +  qL) 
must  also  be  zero.  However,  as  a  consequence  of  (5) 

o_  (I  +  G  ^  +  qL)  ££  (I  +  G  ^)  -  q  a(L) 

>o(I+  G'1)  -  o(L) 


Thus  r(q)  does  not  encircle  the  origin  for  o<q<L  In  particular,  the 
perturbed  contour  r(l)  does  not  encircle  the  origin,  and  the  perturbed  closed- 
loop  system  is  stable. 

Similar  theorems  hold  for  additive  rather  than  multiplicative  perturbations 
(with  I  +  G  substituted  for  1  +  G  *)  as  well  as  a  number  of  other  configurations. 

This  theorem  points  out  the  importance  of  singular  values.  In  particular, 
the  smallest  singular  value  a ( I  +  G(jio)  *)  gives  a  reliable  frequency- 
dependent  measure  of  robustness.  Stability  is  guaranteed  for  all  perturbations 
whose  spectral  norm  is  less  than  a.  As  will  be  seen  in  the  examples,  eigen¬ 
values  do  not  give  a  similarly  reliable  measure. 


The  singular  values  also  have  useful  graphical  interpretations.  Consider 
the  dyadic  expansion 


H 


-1 


I  +  G'1  =  o.r.v* 
1=1  1  1  1 

°lia2-  •••  -°n 


(12) 
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where  the  o.,  r.  and  v.  are  the  singular  values,  and  left  and  right  singular 
11  1  _1 

vectors,  respectively  of  I  +  6  .  This  is  an  alternative  form  of  the  sing¬ 

ular  value  decomposition  in  equation  (2). 

It  has  been  shown  [sj  that  the  eigenvalues  and  eigenvectors  of  a  rational 
matrix  are  continuous  (through  generally  not  rational)  functions  of 
frequency.  Since  singular  values  and  vectors  are  just  special  cases, 

CT^(jw),  r.(joj)  and  v.  (jw)  are  also  continuous  functions  of  w. 

Since 


H  =  (I  +  G'1)'1  =  l  £  v.r.*  (13) 

the  values  l/oj(jw)  and  l/o  (ju>)  give  the  maximum  and  minimum  possible 
magnitude  responses  to  an  input  sinusoid  at  frequency  w.  Eigenvalues  give 
no  such  information.  In  this  sense,  a  plot  of  these  singular  values  vs. 
frequency  may  be  thought  of  as  a  multivariable  generalization  of  the  Bode 
gain  plot.  Plots  of  this  type  will  be  referred  to  as  o-plots. 


Another  useful  graphical  interpretation  analogous  to  the  scalar  Inverse 
Nyquist  diagram  may  be  constructed  by  noting  that 


,-l 


So-iV-i  -  1 


★  ★ 
=  Eo.r.v.  -  zv.v. 
tit  it 

★ 

=  E(a.r.  -  v.)v. 

ii  l  i 


=  EB-g.v. 

i3i  i 


(14) 


where  6-9.  =  a.r.  -  v.  with  b .  real  and  ilg.  I  I  =1  for  all  i. 

ii  ii  i  i  M3i 11 

(The  g^s  do  not  necessarily  form  an  orthonormal  set.) 


The  quantities  in  (14)  at  some  frequency  wo  are  related  as  in  diagram  in 
Fig.  3a.  Since  v .  is  of  unit  length  a  complex  plane  may  be  constructed  as 
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in  Fig.  3b,  to  lie  in  the  plane  formed  by  the  triangle  of  v.,o^r.  and  B^g.. 

Define  z.  to  be  the  complex  number  at  the  point  of  the  triangle  as  in  Fig.  3c. 
Then,  by  rotating  the  complex  plane  with  the  triangle  as  a  function  of 
frequency,  a  z.(jui)  may  be  obtained  which  is  a  continuous  function  of  w 
(Fig.  3d).  This  allows  the  important  quantities  in  (13)  and  (14),  that  is, 
the  o.  and  6.  to  be  represented  in  convenient  graphical  form.  As  noted  in 
Fig.  3d,  there  is  an  ambiguity  to  z.  depending  on  which  side  the  plane  is  viewed. 
(To  be  more  precise,  the  z.  represent  a  multivalued  function  of  s  which  could 
be  defined  on  appropriate  Riemann  sheets.  However,  this  will  be  ignored.) 

The  z.  may  be  calculated  by  finding  the  roots  of  the  quadratic  equation 

z?  +  (1  +  b/  -  o.2)zi  +  $.2  =  0  (15) 

By  plotting  the  z^(jto)  c.  =  l,...m)  for  frequencies  of  interest  a  plot 
analogous  to  the  scalar  Inverse  Nyquist  plot  is  generated.  While  phase 
does  not  have  the  conventional  meaning  on  these  plots,  the  more  important 
notion  of  distance  from  the  critical  point  preserves  its  importance. 

These  plots  will  be  referred  to  as  z-plots. 

Concepts  such  as  M-circles  are  also  obvious  in  this  context.  The  minimum 
value  of  M  is  given  by 

Mm  =  7  (l/cjdM) 

Similar  results  may  be  obtained  for  additive  perturbations  by  workino  with 
I  +  G  rather  than  I  +  G  In  this  case  a  riianran  is  generated  which  is 
analogous  to  the  scalar  Nyquist  diagram.  A  number  of  other  configurations 
may  be  handled  as  well. 
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Note  that  singular  values  offer  no  encirclement  condition  to  test  for 
right  half-plane  poles.  Another  test  must  be  made  for  absolute  stability 
but  this  presents  no  obstacle  as  many  simple  techniques  exist  for  doing 
this.  Once  stability  is  determined  the  various  approaches  presented  in 
this  Section  may  be  used  to  reliably  analyze  robustness. 
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Til.  EXAMPLES 


Two  simple  examples  are  presented  and  analyzed  using  the  approaches 
developed  in  the  previous  section.  For  the  purpose  of  comparison, 
the  methods  of  loop-breaking ,  direct  eigenvalue  analysis  of  G,  and 
diagonal ization  by  compensation  are  also  used.  The  advantage  of 
the  interpretation  of  robustness  given  in  this  paper  is  clearly 
ill ustrated. 

The  first  example  is  an  oscillator  with  open  loop  poles  at  ±10j 
and  both  closed  loop  poles  at  -1.  There  are  no  transmission 
zeros.  The  loop  transfer  function  is 


G(s)  =  — - 

sN-100 


s-100  10(s+l) 


L  -10(s+l )  S-100  J 


(16) 


By  closing  either  loop  (the  system  is  symmetric)  as  in  Figure  4, 
the  transfer  function  for  the  other  loop  is 

g(s>=  i 

which  indicates  °°  db  gain  margin  in  both  directions  and  90°  phase 
margin  in  each  loop  (with  the  other  closed).  This  is  very  misleading, 
however. 

The  z-plot  for  this  example  is  shown  in  Figure  5.  It  may  appear 
somewhat  peculiar,  since  it  is  not  a  plot  of  a  rational  function. 
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The  important  feature  is  the  proximity  of  the  plot  to  the  critical 
point,  indicating  a  lack  of  robustness. 


The  apparent  discrepency  between  these  two  robustness  indications 
can  be  easily  understood  by  considering  a  diagonal  perturbation 


(17) 


where  and  k^  are  constants. 

Then  regions  of  stability  and  instability  may  be  plotted  in  the 
(kj,  k2)  plane  as  has  been  done  in  Figure  6.  The  open  loop  point 
corresponds  to  k^  =  k2  -  -1  and  nominal  closed  loop  point  corresponds 
to  k^  =  k2  =  0.  Breaking  each  loop  individually  examines  stability 
along  the  k^,  k2  axes  where  robustness  is  good,  but  misses  the  close 
unstable  regions  caused  by  simultaneous  changes  in  kj  and  k2-  Thus, 
single  loop  analysis  is  not  a  reliable  way  of  testing  robustness. 

The  second  example  is  a  two  dimensional  feedback  system  with  open- 
loop  poles  at  -1  and  -2  and  no  transmission  zeroes. 


The  loop  transfer  matrix  is 


r-47s  +  2 


G(s)  =  Ts+nTs+2T 


L  -42s 


56s  ' 


50s  +  2  J 


(18) 
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Assume  that  identity  feedback  is  used,  with  closed-loop  poles  at 
-2  and  -4.  This  system  may  be  diagonalized  by  introducing  constant 
compensation.  Let 


7  8 


6  7 


V  =  U" 


Then  letting 


G  =  VGU 


the  system  may  be  rearranged  so  that 


H  =  G ( I  +  G)_i 
=  UGV( I  +  UGV)'1 
=  UG( I  +  G)_1y 
=  U  G(I  +  G)"1]  V. 


This  yields  a  diagonal  system  that  may  be  analyzed  by  scalar 
methods.  In  particular  under  the  assumption  of  identity  feedback 
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G  represents  the  new  loop  transfer  matrix.  Because  U  and  V 
represent  a  similarity  transformation,  the  diagonal  elements  of 
G  are  also  the  eigenvalues  of  G  so  that  the  decoupling  or  dominance 
approach  and  eigenvalue  or  characteristic  loci  approach  would  gen¬ 
erate  the  same  Nyquist  or  Inverse  Nyquist  plot  shown  in  Figure  7. 
Only  a  single  locus  is  shown  since  the  contours  of  1/ ( s  +  1)  and 
2/ ( s  +  2)  are  identical.  The  tempting  conclusion  that  might  be 
reached  from  these  plots  is  that  the  feedback  system  is  emminently 
robust  with  apparent  margins  of  ±  °°  db  in  gain  and  90°+  in  phase. 
The  closed-loop  pole  locations  would  seem  to  support  this. 

This  conclusion,  however,  would  be  wrong.  The  z-plot  for  I  +  G* 
is  shown  in  Figure  8  and  there  is  clearly  a  serious  lack  of  robust¬ 
ness.  The  (kp  k2)  -  plane  stability  plot  for  this  example  is 
shown  in  Figure  9.  Neither  the  diagonal  dominance  nor  eigenvalue 
approaches  indicate  the  close  proximity  of  an  unstable  region. 

This  failure  can  be  attributed  to  two  causes. 

First,  the  eigenvalues  of  a  matrix  do  not,  in  general,  give  a 
reliable  measure  of  its  distance  (in  a  parametric  sense)  from 
singularity,  and  so  computing  the  eigenvalues  of  G(s)  (or  I  +  G( s ) ) 
does  not  give  an  indication  of  robustness.  Using  eigenvalues 
rather  than  singular  values  will  always  detect  unstable  regions 
that  lie  along  the  k^  =  k^  diagonal,  but  may  miss  regions  such 
as  the  one  in  Figure  9. 

Second,  when  compensation  and/or  feedback  is  used  to  achieve 
dominance,  the  "new  plant"  includes  this  compensation  and  feed¬ 
back.  Because  of  this,  no  reliable  conclusions  may  be  drawn  from 
this  "new  plant"  concerning  the  robustness  of  the  final  design  with 
respect  to  variations  in  the  actual  plant.  It  is  important  to 
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evaluate  robustness  where  there  is  uncertainty. 


Another  important  property  of  multiloop  feedback  is  that,  unlike 
scalar  feedback,  pole  locations  alone  are  not  reliable  indicators 
of  robustness.  This  was  demonstrated  in  the  last  example  and  may 
be  explained  as  follows.  Consider  a  state  feedback  problem  where 
the  plant  is  controllable  from  each  of  two  ’nputs.  One  input  may 
be  used  to  place  the  poles  far  into  the  right  half  plane  and  the 
other  used  to  bring  them  back  to  the  desired  location.  Such  a 
high-gain  control  design  of  "opposing"  loops  will  be  extremely 
sensitive  to  parameter  variations  regardless  of  the  nominal  pole 
locations. 

It  is  interesting  to  examine  the  o-plot  of  H  =  G(I  +  G)"1  for  the 
second  example  shown  in  Figure  10.  Recall  that  the  singular  values 
of  H  are  equal  to  the  inverses  of  the  singular  values  of  I  +  G~^. 
There  is  a  rather  large  peak  in  the  frequency  response  at  approxi¬ 
mately  3  radians.  This  could  not  occur  in  scalar  unity  feedback 
systems  without  there  being  a  pole  relatively  near  the  imaginary 
axis.  It  can  happen  in  multiloop  systems  because  of  the  high 
gains  possible  without  correspondingly  large  pole  movement. 


92 


AD-A075  806 

UNCLASSIFIED 

2  of  2  ■ 

AO  H 

AO?seoe 


HONEYWELL  SYSTEMS  AND  RESEARCH  CENTER  MINNEAPOLIS  MN  F/6  12/1 

OPTIMAL  LINEAR  CONTROL  (CHARACTERIZATION  AND  LOOP  TRANSMISSION  — ETC(U) 
AU6  78  C  A  HARVEY  ,  J  C  DOYLE  N00014-75-C-0144 

78SRC73 _ 0NR-CR2 15-238-3  NL 


END 

DATE 

FILMED 

-I/-79 


DDC 


IV.  FURTHER  COMMENTS  AND  CONCLUSIONS 


The  approach  to  the  analysis  of  robustness  presented  here  appears  to  yield 
useful  insight  into  the  properties  of  multiloop  feedback  systems  which  may 
provide  the  basis  for  a  multivariable  stability  specification  analogous  to 
gain  and  phase  margins  for  scalar  systems.  One  possible  difficulty  with 
the  approach  is  that  it  can  lead  to  overly  pessimistic  views  of  robustness 
because  it  considers  perturbations  which  may  not  be  physically  possible. 

This  problem  exists  as  well  with  gain  and  phase  margin  evaluations.  Of 
course,  some  of  this  difficulty  can  be  alleviated  by  examining  the  specific 
perturbations  leading  to  instability.  These  may  be  easily  computed  from 
equation  (  12  ).  On  the  other  hand,  it  might  be  argued  that  some  healthy 

pessimism  would  be  refreshing  in  the  field  of  multivariable  linear  control 
research. 

Although  for  simplicity's  sake  only  rational  transfer  functions  were  considered 
the  results  in  this  paper  should  extend  to  nonrational  transfer  functions.  In 
practical  application  it  should  be  possible  to  use  frequency  response  data 
directly. 

The  results  may  also  be  extended  to  include  nonlinear  perturbations  by  exploiting 
the  general  stability  theory  developed  by  Safonov  Jl3j  .  In  this  setting, 
nonlinearities  may  be  loosely  viewed  as  linear  time-invariant  elements  with 
time-varying  parameters.  A  mathematically  more  rigorous  treatment  of  these 
issues  may  be  found  in  Zames(  jl 4J  ,  Jl5j  ),  as  well  as  in  Jl3j 

The  results  in  this  paper  concerning  dominance  methods  and  use  of  characteristic 
loci  of  the  looo  transfer  matrix  are  not  meant  to  imply  that  design  procedures  employ¬ 
ing  these  methods  are  useless.  However,  simply  designing  "in  the  frequency 
domain"  is  no  guarantee  that  resulting  controllers  will  have  no  undesirable 
properties. 


Multivariable  diagrams  such  as  the  o  and  z-  plots  appear  to  be  amenable  to 
implementation  on  a  computer  with  graphic  and  plotting  capability.  Singular 


values  and  vectors  are  particularly  easy  quantities  to  compute  [l6j  .  This 
should  facilitate  their  active  use  in  multiloop  feedback  design  procedures. 
The  question  naturally  arises  concerning  the  implications  of  the  singular 
value  approach  for  robust  synthesis.  Certainly,  this  appears  to  be  a 
promising  area  for  research. 
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APPENDIX  F 


MULTIVARIABLE  FEEDBACK  DESIGN 
USING  THE  INVERSE  NYQUIST  ARRAY 
by  J.  C.  Doyle 


An  analysis  of  a  design  presented  by  Rosenbrock1  provides  the  framework  for 
discussing  the  potential  applicability  of  the  diagonal  dominance/ Inverse 
Nyquist  Array  methods.  Rosenbrock  uses  his  techniques  on  an  example  problem 
which  is  presented  for  the  sole  purpose  of  demonstrating  the  obvious 
superiority  of  his  methods.  One  might  expect  that  under  these  circumstances, 
the  diagonal  dominance/inverse  Nyquist  Array  methods  would  look  good.  The 
following  analysis  shows  that  this  is  emphatically  not  the  case. 


The  example  Rosenbrock  treats  has  the  matrix  transfer  function 


G(s)  = 


1  -  s  2  -  s 

(1  +  s)2  (1  +  s)2 

1  -  3s  1  -  s 

3(1  +  s)2  (1  +  s)2 


"Design  of  Multivariable  Control  Systems  Using  the  Inverse  Nyquist 
Array",  PROP.  IEE,  Vol.  110,  No.  11,  November  1969. 


Unfortunately,  since  no  physical  system  is  given,  we  are  left  guessing  as 
to  what  the  model  might  mean.  Note  that  all  the  dynamics  are  around  1 
radian  so  we  might  conjecture  that  the  validity  of  the  model  is  limited 
to  fairly  low  frequencies. 

Rosenbrock  applies  his  Inverse  Nyqulst  Array/  diagonal  dominance  methods 
and  comes  up  with  the  feedback  gain  matrix 

-2  -6 

K  =  50 

2  3 

_  7 

Rosenbrock  comments  that  the 

"...example  is  not  a  trivial  one.  The  original  system 
allows  four  different  single  control  loops  to  be  set  up.  All 
of  these  have  nonminimum  phase,  and  they  all  present  consider¬ 
ably  more  difficulty  than  either  of  the  two  dominant  loops. 

Attempts  to  set  up  two  loops  simultaneously  around  the  original 
system  are  equally  unpromising.  Yet  only  a  matrix  of  constant 
interconnections  is  needed,  to  allow  two  simultaneous  loops  of 
relatively  good,  and  easily  Improved,  performance.  The  method 
described  allows  this  matrix  to  be  obtained  by  a  systematic 
procedure,  which  can  take  account  of  engineering  constraints." 
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Let's  analyze  the  performance  of  Rosenbrock's  design.  The  closed  loop 
system  Is 


150s  (s+1) 


50  (3s2+4s+51) 


with  poles  at 

s  =  -.746  ±  3.77  j,  -176.5. 

The  pole  locations  should  be  an  Immediate  cause  for  concern.  There  is 
a  fairly  oscillatory  pair  and  one  at  -176.5  ???  Hmmm.  Seems  a  might 
far  out  for  a  system  that  started  out  with  poles  at  -1. 

How  about  singular  values?  The  o-plot  for  I  +  (KG)-1  is  shown  In 
Figure  1.  (This  is  the  margin  plot  for  loops  broken  at  the  inputs. 

The  minimum  value  of  a  Is  a  measure  of  the  size  of  the  perturbation 
which  may  be  tolerated  without  instability.) 


H(s) 


1 

P~TsT 


25  (s‘  +  3s  +  102) 


j  25  (s+1 )  (3s+5) 
3 


Pc(s) 


s3  ♦  178  s2  ♦  278  s  ♦  2601 


Note  that  the  minimum  o  Is  .1.  Not  so  hot.  Equally  interesting  Is 
that  the  minimum  a  stays  below  .5  all  the  way  out  to  nearly  200  radians. 


SEE 


The  bandwidth  is  clearly  excessive  making  the  system  extremely  sensitive 
to  noise  and  modelling  errors.  Further,  the  poor  low  frequency  stability 
margins  will  result  in  poor  robustness  and  highly  oscillatory  responses. 
(See  Fig.  2).  While  designs  with  these  difficulties  are  not  entirely 
unavoidable  when  using  Diagonal  Dominance  techniques,  there  is  an  inherent 
tendency  toward  them  because  of  the  questionable  restriction  to  single- 
degree-of-freedom  controllers. 

While  generally  ignoring  questions  of  robustness  (which  is  the  fundamental 
feedback  issue)  the  dominance  approach  does  not  even  insure  decoupled 
responses,  in  spite  of  this  being  the  only  real  goal  of  the  approach. 

The  step  response  of  Rosenbrock's  closed  loop  system  is  shown  in  Fig.  2. 
The  response  is  highly  coupled  and  oscillatory. 
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It  is  interesting  to  note  that  if  we  assume  that  diagonalization  Is  In 
fact  desirable,  it  is  fairly  easy  to  come  up  with  an  adequate  design  by 
inspection.  Using  the  compensator 


K  = 


120  (1-s)  .  120( 

10  +s 


40  (l-3s)  120  (1-s) 

10  +  s  10  +  s 


in  the  configuration 


t 


- p 


yields 


G  K  = 


40 

s2  +  US  +  10 


and  for  the  closed  loop  system 


0 

1 


H  = 


40 

s2  +  US  +  50 


0 

1 
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CNJ  + 


* 


Adding  some  feed  forward  to  give  unity  steady-state  response  to  a 
step,  we  get  the  step  response  in  Figure  3.  The  o-plot  for  I  +  (KG)’1 
is  shown  in  Figure  4.  It  doesn't  matter  for  my  design  if  the  loops 
are  broken  at  inputs  or  outputs.  Rosenbrock's  o-plot  is  shown  by  a 
dotted  line  in  Figure  4  for  comparison. 

Beyond  noting  the  obvious  huge  Improvement  In  transient  response  and 
robustness,  It's  rather  meaningless  to  attempt  further  comparison  of  the 
two  designs  without  knowledge  of  exactly  what  physical  system  the  model 
Is  Intended  to  represent. 

In  summary,  it  seems  clear  that  the  diagonal  dominance/INA  approach  does 
not  live  up  to  the  claims  made  for  it.  The  attempt  to  extend  the  classical 
frequency  domain  techniques  to  multivariable  systems  is  laudable,  but 
unfortunately  the  INA  represents  a  very  preliminary  and  primitive  step 
In  this  extension.  The  classical  frequency-domain  techniques  are  attrac¬ 
tive  In  that  they  make  certain  key  characteristics  of  a  SISO  system 
readily  apparent  to  the  designer  in  a  simple  graphical  form.  The  Inverse 
Nyquist  Array  seems  to  confuse  and  obscure  the  critical  multivariable 
Issues  rather  than  clarify  them. 
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There  seems  to  be  no  point  to  diagonal ization  of  the  return  difference  matrix 
except  to  simplify  the  design  procedure.  The  cost  of  such  a  diagonal ization 
will  often  be  too  great  for  highly  coupled  multivariable  systems.  If  a 
decoupled  response  is  actually  desired,  and  this  is  far  from  being  a  standard 
design  specification,  it  seems  more  reasonable  to  achieve  this  with  a  two- 
degree-of-freedom  controller  using  a  combination  of  feedback  and  pre¬ 
compensation  where  the  internal  dynamics  need  not  be  diagonalized  or  dominant. 

There  does  not  appear  to  be  much  motivation  to  develop  a  capability  in 
the  Inverse  Nyquist  Array  methods.  The  methods  are  clearly  inadequate  as 
they  stand,  and  the  underlying  assumptions  prevent  any  extensions  that  would 
overcome  the  inherent  weaknesses. 
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MULTIVARIABLE  FEEDBACK  DESIGN  USING 
CHARACTERISTIC  LOCI 

By  J.C.  Doyle 


An  interesting  approach  to  multivariable  feedback  design  is  the  characteris¬ 
tic  loci  (CL)  methodology  developed  by  A.  G.  MacFarlane.  Reference  [lj 
gives  a  thorough  description  of  this  approach  so  I  won't  repeat  what's  there. 
My  conclusion  from  working  some  simple  examples  and  from  studying  the  pro¬ 
perties  of  the  CL  approach  is  that  it  is  inadequate  for  our  needs  and  there 
seems  to  be  little  motivation  to  develop  a  capability  in  it. 

We  already  know  that  the  eigenvalues  of  the  return  difference  matrix  (which 
are  used  in  CL)  are  not  reliable  measures  of  robustness  (see  example  2  in 
).  An  equally  serious  difficulty  with  the  CL  approach  is  the  tendency 
to  very  high  bandwidth  feedback  loops.  While  this,  of  course,  gives  very 
fast  responses  on  paper,  it  leads  to  unstable  plants  when  all  the  dynamics 
and  uncertainty  are  thrown  in.  This  stems  partially  from  the  obsession  of 
making  the  loop  dynamics  noninteracting.  Even  if  a  closed-loop  decoupled 
response  is  desired,  there  is  absolutely  no  need  to  diagonalize  the  loop 
dynamics  unless  there  is  some  aversion  to  using  precompensation.  Feedback 
loop  diagonalization  constrains  the  solution  enough  that  It  is  often 
impossible  to  achieve  a  robust  feedback  design. 

This  can  be  seen  by  considering  an  example  design  taken  from  j^lj  .  The 
following  is  excerpted  from  £lj  : 


118 


"The  example 

used  here  to  illustrate 

the  use 

technique  is  based 

on  a  model 

of  an  open-loop  uns 

reactor 

.  Its  state-space  description  is 

given  by 

matrices 

1-38 

-0-2077 

6-715 

-5*676 

-0-5814 

-4-29 

0 

0*675 

1-067 

4-273 

-6*654 

5-893 

0-048 

4*273 

1-343 

-2*104 

0 

0 

5*679 

0 

1  0 

1  -1 

= 

1-136 

-3*146 

• 

C  = 

1-136 

0 

0  1 

0  0 

_ 

_ 

corresponding  to  a  transfer-function  matrix 


G(s)  =  — 
Ao(S) 


r13  (s) 
r2 1 ( s ) 


r  1 2  ( s  ) 
r2 2  ( s  ) 


where 

A0(s)  =  s4  +  1 1 -67s3  +  15*75s2  -  88-31s  +  5-514 
rn  (s)  =  29-2s  +  263*3 

r 1 2 ( s )  =  -3*1 46s 3  -  32*62s2  -  89-83s  -  31*81 
r2 1 ( s )  =  5*679s3  +  42*67s2  -  68*84s  -  106-8 
r22(s)  =  9*43s  +  15-15 

The  set  of  poles  is  {0-06318,  1*991,  -5-057,  -8*666}." 


119 


The  design  which  is  finally  arrived  at  using  the  characteristic 
loci  approach  has  a  feedback  gain  matrix  of 


The  closed-loop  poles  are  at  {-l+.07j ,-2.68,  -4.03,  -62.5,  -117}.  The  pol 
at  -62.5  and  -117  suggest  excessive  bandwidth  and  the  singular  values  of 
I  +  (KG)-*  confirm  this  as  shown  below. 


i 


Note  that  both  singular  values  are  below  2  at  100  radians.  It's  very  hard 
to  believe  that  a  chemical  reactor  would  be  modelled  that  accurately  at  such 
high  frequencies  when  the  four  poles  in  the  model  are  all  smaller  than  10 
radians.  A  couple  of  extra  unmodelled  poles  at  around  -50  and  this  system 
is  closed-loop  unstable. 

SUMMARY 

The  characteristic  loci  approach  represents  a  sophisticated  attempt  at 
extending  frequency  domain  techniques  to  the  multivariable  setting.  Some 
interesting  ideas  have  come  out  of  this  approach,  including  the  notion  of 
an  approximately  commutative  compensator  and  the  use  of  eigenvalues  of  the 
return  ratio  matrix  to  characterize  the  system.  Unfortunately,  eigenvalues 
are  not  the  right  quantities  to  study  as  has  been  amply  demonstrated.  The 
major  drawback  to  the  practical  use  of  the  CL  approach  beyond  the  inadequacy 
of  eigenvalues  is  the  requirement  of  extremely  high  feedback  loop  band- 
widths.  This  requires  that  there  be  virtually  no  uncertainty,  in  which 
case  feedback  is  unnecessary. 

The  rather  complete  neglect  of  robustness  issues  make  the  CL  approach  in¬ 
adequate  for  feedback  design  and  the  limitations  are  so  intimately  tied 
with  the  methodology  that  useful  extensions  appear  unlikely.  However,  the 
literature  surrounding  the  characteristic  loci  methods  is  rich  in  mathe¬ 
matical  techniques  and  insights. 

A  further  comment  which  applies  to  both  the  INA  and  the  CL  methods  is  that 
they  are  limited  to  square  systems.  Our  results  in  advanced  filter/observer 
design  techniques  show  that  additional  measurements  are  very  useful  for 
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improving  robustness.  It  is  clear  that  having  to  square  down  the  system 
before  the  design  begins  is  a  limitation. 
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SINGULAR  VALUES  AS  FUNCTIONS  OF  A 
COMPLEX  VARIABLE 

By  J.  C.  Doyle 

INTRODUCTION 

While  the  robustness  results  using  singular  values  concentrates  on  matrix 
transfer  functions  Q(s)  where  s  =  j  w,  additional  insight  may  be  gained 
by  considering  the  singular  values  of  Q(s)  where  s  ranges  over  the 
entire  complex  plane.  (For  our  purposes  Q(s)  may  be  taken  as  the  loop 
transfer  function  G(s),  I  +  G(s),  I  +  G(s)“,  or  whatever  transfer  function 
is  of  interest).  This  is  similar  to  the  approach  taken  by  MacFarlane 
and  Postlethwaite  [ij  ,  except  that  they  consider  the  eigenvalues  of 
Q(s)  rather  than  its  singular  values.  The  development  which  follows 
parallels  closely  that  in  £lj  ,  with  the  exception  being  that  the 
eigenvalues  of  Q(s)T  Q(s)  rather  than  of  Q(s)  are  considered  where  s 
indicates  the  conjugate  of  s 

PRELIMINARIES 

Let  Q(s)  be  an  mxm  rational  transfer  function.  For  any  specific  value  of 
s,  say  so>  the  matrix  Q(sq)  will  have  a  set  of  singular  values  {a(sQ)|i=l, 
...m}.  Thus,  the  singular  values  of  Q(s)  may  be  thought  of  as  functions 
of  the  complex  variable,  s.  The  properties  of  these  functions  form  the 
topics  of  this  discussion. 
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The  characteristic  equation  which  defines  the  singular  values  is 


det  jo  I  -  Q(s)TQ(s)]^(a,s,I)  =  0  (1) 

Where  a  is  the  square  of  the  singular  values.  We  will  concentrate  on  a 
and  remember  that  a  =  a2. 

Assuming  that  v(ct,s,s)  is  Irreducible  over  the  field  of  rational  functions 
of  s  and  s,  we  may  write 

V(a,s,D  =  am  +  P1  (s,s)a  m_1  +  ...pm(s,s).  (2) 

where  p.(s,s)  3  p^T.s)  for  all  1  *  l,...m.  (If  v(a,s,7)  Is  reducible, 
the  argument  applies  to  each  of  Its  factors.) 

If  bo(7,s)  is  the  least  common  denominator  of  the  coefficients  {p^s.F): 
1=1, ...m),  (2)  may  be  put  In  the  form 

60(s,i)  bjls.D  a""1  ♦  ...bjs.s)  •  0  (3) 

where  b^ls.s)  =  b^ts.s)  for  all  1=1, ...m.  Following  [l],  It  may  be  shown 
that 


b0(s,s)  =  |y(s) |2  (4) 

and  bpp  ( s » s )  =  |*(s)|2  (5) 

where  v(s)  and  ( s )  are  the  pole  and  zero  polynomials,  respectively,  of 

Q(s). 

It  Is  now  obvious  that  a  Is  not  an  algebraic  function  of  s  due  to  the 
presence  of  the  I  In  the  coefficients  of  (3).  Thus  It  is  difficult  to 
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make  precise  the  exact  nature  of  the  multivalued  map  from  seC  to  aeR 
defined  by  (3).  In  particular,  the  use  of  analytic  continuation  is  in¬ 
adequate  to  describe  a  map  from  a  domain  forming  a  Riemann  surface,  since 
the  corresponding  branches  of  the  multivalued  map  in  (3)  are  not  locally 
analytic. 

Because  of  this,  the  following  results  are  not  mathematically  rigorous  and 
additional  work  is  needed  to  make  them  so.  Nevertheless,  the  qualitative 
insights  available  are  useful  and  worth  considering. 

Properties  of  Singular  Values  of  Q(s) 

Let  a(s)  be  the  multivalued  function  defined  by  the  roots  of  (3).  Then 
a(s)  will  nave  in  general  m  distinct  roots.  An  exception  occurs  only  if 

(a)  bQ(s,i)  =  Ms)]2  =  0,  because  the  degree  of  (3)  is  lowered,  or  if 

(b)  equation  (3)  has  multiple  roots. 

DEFINITIONS 

1 .  Ordinary  Points  of  a(s) 

An  ordinary  point  of  a's)  is  any  point  in  the  complex  plane  such  that 
neither  (a)  nor  (b)  is  tr  e. 

2.  Critic*!  Points  of  g(s) 

A  critical  point  of  a(s)  is  any  point  in  the  complex  plane  such  that 
either  (a)  or  (b)  is  true  or  both  (a)  and  (b)  are  true. 
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3.  Branch  Point  of  a(s) 

A  branch  point  of  a(s)  is  any  point  in  the  complex  plane  such  that  (b) 
is  true. 

Every  point  in  the  complex  plane  is  either  an  ordinary  point  or  a  critical 
point.  The  function  a(s)  may  be  thought  of  as  a  set  of  m  functions  each 
defined  on  the  complex  plane  punctured  by  the  critical  points.  Each  of 
these  (non-unique)  functions  will  be  called  a  branch  of  a(s).  The  arguments 
used  by  Knopp  2  to  prove  that  the  branches  of  algebraic  functions  are 
continuous  may  be  extended  to  prove  that  the  branches  of  a(s)  are  continuous. 
However,  as  mentioned  before,  the  branches  are  not  analytic  functions  so  the 
technique  of  analytic  continuation  may  not  be  used  to  redefine  the  domain 
of  the  functions.  Thus,  while  we  may  talk  of  a  Riemann  surface  as  constitu¬ 
ting  the  domain  of  a(s),  this  notion  has  not  been  made  precise. 

In  view  of  (3),  (4),  and  (5)  we  may  state  the  following: 

1.  If  sc  is  a  closed-loop  pole  of  the  system  [i  +  G(s)"^J"\  then 

o  [i  +  G(s)]=  0 


o  [i  +  G"1  ( s )]  =  0 
2.  If  so  is  an  open-loop  pole  of  the  system  G(s),  then 

lim  o^I+G(s)J=“ 
s"so 


and 


1  im 
s+s„ 


1  im 
s-s. 
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3.  If  z  is  a  transmission  zero  of  G(s),  then 


Tim  o  [i  +  G” 1 2 3  ( s )]  =  =0 
s^-z 


4.  More  generally,  if  sQ  and  z  are  poles  and  zeroes,  respectively,  of 
Q(s),  then 


lim  o_  (Q(s ) )  =  0 
s-*z 


lim  a  (Q ( s ) )  = 
s^o 

A  number  of  qualitative  observations  concerning  the  map  o(s)  =  Ms))** 
may  be  made. 

1.  Poles  and  zeroes  of  Q(s)  which  are  near  each  other  on  the  complex 

plane  will  not  tend  to  cancel  unless  they  appear  on  the  same  branch  of  a(s). 

2.  If  a  closed  loop  pole  of  £l  +  G(s)"1]"1  is  close  to  the  imaginary 

axis,  there  will  be  a  tendency  for  £  (I  +  G(jw))  and  £  (I  +  G(jw)~*) 

to  be  small  near  that  pole  unless  it  Is  canceled  by  a  pole  of  I+G(s) 

or  I+G_1(s). 

3.  As  shown  in  [3],  having  all  the  zeroes  of  Q(s)  far  from  the  imaginary 
axis  does  not  insure  that  £(Q(jw  ))  may  not  be  small.  While 
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it  is  true  that 


m 

n  a  As) 
1=1  1 


♦  (s) 


i'(s) 


where  <t>  and  y  are  the  zero  and  pole  polynomial  respectively  of  Q(s), 

it  may  that  a(jw)  <<  o’(ju)  for  some  w  and  £  may  be  small  even  though 

n  0.  is  large. 
i=l  1 

4.  Consider  Individually  each  branch  of  a(s)  =  (a ( s))^  as  a  function 
on  the  punctured  complex  plane.  We  may  imagine  each  branch  as  a  con¬ 
tour  where  the  height  of  the  contour  at  a  point  s  is  the  value  of  the 
branch  function  at  that  point.  The  robustness  properties  of  a  system 
then  depend  on  the  heights  of  the  contours  of  the  branches  of 
a ( I_G ( s ) )  or  0(I_G(s)"*)  along  the  imaginary  axis. 

Additional  research  is  needed  to  make  precise  the  notions  presented 
here.  We  anticipate  that  the  use  of  singular  values  over  the  entire 
complex  plane  will  prove  to  be  a  useful  extension  to  the  notion  of  a 
scalar  transfer  function  defined  on  the  complex  plane. 
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ROBUSTNESS  WITH  OBSERVERS 
by  J.  C.  Doyle  and  G.  Stein 


ABSTRACT 

This  paper  describes  an  adjustment  procedure  for  observer-based  linear 
control  systems  which  asymptotically  achieves  the  same  locp  transfer 
functions  (and  hence  the  same  relative  stability,  robustness,  and  distur¬ 
bance  rejection  properties)  as  full-state  feedback  control  implementations. 


n? 


I .  Introduction 


The  trouble  with  observers  is  that  they  tempt  us,  through  the  expedient  of 
state  reconstruction,  to  assign  undue  generality  to  control  results  proven 
only  for  the  full-state  feedback  case.  An  example  is  the  recent  robustness 
result  of  Safonov  and  Athans  £l].  This  result  shows  that  multivariable 
1  inear-quadratic  optimal  regulators  have  impressive  robustness  properties, 
including  guaranteed  classical  gain  margins  of  -6  db  to  +  00  db  and  phase 
margins  of  +  60  deg.  in  all  channels.  The  result  is  only  valid,  however, 
for  the  full  state  case.  If  observers  or  Kalman  filters  are  used  in  the 
implementation,  no  guaranteed  robustness  properties  hold.  In  fact, 
a  simple  example  has  shown  that  legitimate  LQG  controller-filter 
combinations  exist  with  arbitrarily  small  gain  margins  in  both  the  positive 
and  negative  db  direction  12]. 

In  light  of  these  observations,  the  robustness  properties  of  control  systems 

with  filters  or  observers  need  to  be  separately  evaluated  for  each  design. 

Moreover,  because  such  evaluations  can  come  up  with  embarassingly  small 

margins,  a  "design  adjustment  procedure"  to  improve  robustness  would  be  very 

desirable.  The  present  paper  provides  such  a  procedure.  We  show  that  while 

the  commonly  suggested  approach  of  "speeding-up"  observer  dynamics  will  not 

work  in  general,  alternate  procedures  which  drive  some  observer  poles 

toward  stable  plant  zeros  and  the  rest  toward  infinity  do  achieve  the  desired 

objective.  In  effect,  full -state  robustness  properties  can  be  recovered 

asymptotically  if  the  plant  is  minimum  phase.  This  occurs  at  the  expense  of 
noise  performance. 
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The  principal  results  of  the  paper  are  summarized  in  Section  II,  where  we 
introduce  and  interpret  certain  transfer  function  properties  of  observer- 
based  control  systems,  and  in  Section  III,  where  we  develop  the  "adjustment 
procedure".  A  simple  example  which  illustrates  these  results  is  given  in 
Section  IV. 
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I I .  Transfer  Function  Properties  of  Observer-Based  Controllers 

We  consider  the  general  multivariable  control  loop  illustrated  in  Figure  1. 

The  plant  is  an  n-th  order  linear  system,  both  observable  and  controllable, 

with  m  inputs,  p-m  outputs,  and  no  transmission  zeros  ^3*1  in  the  right  half 

plane.  The  control  law  consists  of  two  transfer  function  matrices  l-^(s)and 

H^s).  is  driven  either  with  full-state  feedback  (Fig.  1A)  or  with  an 

r  i 

n-th  order  "model -reference  observer"  [4j  which  reconstructs  the  state  in  the 
usual  asymptotic  sense  (Fig.  IB).  It  is  clear  that  this  overall  control  loop 
includes  1 inear-quadratic-gaussian  controllers  as  special  cases.  It  also 
allows  dynamic  elements  such  as  integrators  and  lag  elements  which  may  be 
required  in  more  realistic  control  situations. 


This  configuration  also  applies  to  nonsquare  plants  for  which  the  number  of 
controls,  m,  is  not  equal  to  the  number  of  measurements,  p.  For  the  case, 
m<p,  simply  augment  the  original  control  vector  with  (p-m)  more  components 
which  are  not  driven  by 
the  B  matrix  for  these  added  components  must,  of  course,  be  selected  to  intro¬ 
duce  no  unstable  transmission  zeros. 


i  i  y  i  1 1  a  i  uui  i  L  r  u  i  vctiui  w  i  lm  \  hi  /  mure  v«umpui  iei  i  to 

the  controllers  (i.e.,  h|  =  h|^:o|).  Columns  of 


For  the  case,  m>p,  select  any  p-  dimensional  subset  of  controls  for  which 
there  are  no  right  half  plane  transmission  zeros.  Then  the  loop  transfer 
properties  which  are  established  in  this  paper  apply  to  this  p-dimensional 
subset  of  control  loops,  with  the  remaining  (m-p)  loops  closed. 

A  dashed  line  is  shown  in  both  Figure  1A  and  IB  in  order  to  distinguish 
between  elements  of  the  loop  which  are  part  of  the  controller  and  those 
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which  are  part  of  the  plant.  Since  we  design  and  implement  the  controller, 
there  is  relatively  little  uncertainty  associated  with  it,  whereas  there  may 
be  significant  differences  between  the  actual  plant  and  its  model.  The  loop 
transfer  functions  which  we  examine  for  robustness .below,  are  then  taken  with 
respect  to  the  loop  breaking  point,  X,  at  the  control  signal  interface  between 
these  two  sets  of  elements.  Very  misleading  robustness  results  can  be  ob¬ 
tained  for  alternate  loop  breaking  points,  for  example  point  XX.  This  is 
also  shown  below. 

The  following  properties  can  be  established  for  the  above  two  control  loop 
implementations: 

Property  1 

The  closed  loop  transfer  function  matrices  from  command  r  to 
state  x  are  identical  in  both  implementations. 

Property  2 

The  loop  transfer  function  matrices  from  control  signal 
u'  to  control  signal  u  (loops  broken  at  point  XX)  are 
identical  in  both  implementations 

Property  3 

The  loop  transfer  function  matrices  from  control  signal 
u"  to  control  signal  u'  (loops  broken  at  point  X)  are 
generally  different  in  the  two  implementations  even  when 
the  observer's  error  dynamics  are  allowed  to  be  arbitrarily 
fast. 
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Property  4 

The  loop  transfer  function  matrices  from  u"  to  u'  are 
identical  in  both  implementations  if  the  observer 
dynamics  satisfy 

K  [  I  +  C  ( sI-A)-1K  ]  _1  =  B  [c(sI-A)_1B  j  _1 

for  all  values  of  the  complex  variable  s.  The  A,  B, 
and  C's  above  are  plant  matrices  and  K  is  the  observer 
gain. 


(1) 


The  first  two  of  these  properties  are  very  well  known  ^5,6  .  They  can  be 
easily  verified  by  noting  that  the  transfer  functions  from  u'  to  x  and  from 
u'  to  x  are  identical  because  the  nominal  error  dynamics  of  the  observer  are 
not  controllable  from  u'.  These  two  properties  are  also  the  source  of  much 
of  the  temptation  surrounding  observers,  however.  We  see  that  input/output 
properties  are  the  same  and  even  certain  loop  transfer  functions  are  the 
same.  The  latter  promise  equal  relative  stability  properties,  equal  toler¬ 
ance  to  uncertainties  (robustness),  and  equal  disturbance  rejection  properties. 
What  more  could  we  ask  for? 


The  problem,  of  course,  is  that  the  loop  transfer  properties  are  the  same 
at  Point  XX,  inside  our  own  control  implementation  where  only  masochists 
would  insert  significant  uncertain  elements  or  disturbances.  According  to 
Property  3,  equal  loop  transfer  characteristics  are  not  obtained  at  the 
control  signal  interface  to  the  plant.  Point  X,  where  Nature  gets  to  insert 
uncertainties  and  disturbances.  It  is  at  this  point  that  robustness  prop¬ 
erties  must  be  measured,  and,  as  seen  in  [2],  it  is  here  that  observer- 
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based  implementations  can  fall  well  short  of  our  objectives. 


Property  3  will  be  verified  by  means  of  example  later.  We  now  turn  instead 
to  the  more  interesting  Property  4.  This  result  is  apparently  not  as  well 
known,  so  a  simple  derivation  is  given  in  Addendum  1.  It  is  important  be¬ 
cause  it  offers  a  way  to  adjust  observers  so  that  full-state  loop  transfer 
characteristics  are  recovered  at  Point  X.  In  particular,  suppose  the  observer 
gains  are  parameterized  as  a  function  of  a  scalar  variable  q.  Let  this 
function,  K(q),  be  selected  such  that  as  q  +  ® 

K(q)  -  q  BW  (2) 

for  any  nonsingular  matrix  W.  Then  equation  (1)  will  be  satisfied  asymtot- 
ically  as  q  -*■  <*>.  The  resulting  observer  error  dynamics  will  have  limiting 
poles  given  by  roots  of  the  polynominal 

X ( s )  =  det(sI-A)det  +  qC(sI-A)'*BW  j  t  ^ 

P  of  these  roots  will  tend  toward  the  P  finite  transmission  zeros  of  the 
plant  (stable  by  assumption)  and  the  rest  will  tend  to  infinity.  It  is 
clear  from  this  that  the  commonly  suggested  approach  of  making  all  roots  of 
the  error  dynamics  arbitrarily  faster  is  generally  the  wrong  thing  to  do. 
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III.  An  Observer-Adjustment  Procedure 


Equation  (2)  defines  the  required  limiting  characteristics  of  an  adjustment 
trajectory,  K(q),  which  changes  arbitrary  initial  nominal  observer  gains, 
K(o),  with  poor  robustness  properties  into  better  gains  asymptotically.  We 
still  need  to  define  details  of  such  trajectories. 

A  basic  requirement  for  every  point  of  an  adjustment  trajectory  is  stabil¬ 
ity  of  the  observer  error  dynamics.  Clearly,  if  we  violate  this  require¬ 
ment,  overall  closed  loop  stability  is  also  lost.  (Note  that  this  does 
not  mean  that  the  net  compensator  within  the  dashed  lines  of  Figure  IB 
needs  to  be  stable.)  One  way  to  assure  stable  error  dynamics  is  to 
restrict  the  observer  to  be  a  Kalman  filter  for  some  set  of  noise  param¬ 
eters.  That  is,  let 

K(q)  =  z(q)  CT  R'1 

with  l(q)  defined  by  the  Riccati  equation 

AS  +  IAT  +  Q(q)  -  zcWr  =  0 

As  usual  we  take  Q  =  QT  >,o  and  R  =  RT  >o.  For  Kalman  filters,  these 
matrices  represent  given  process  noise  and  measurement  noise  intensities, 
respectively.  Here  they  are  treated  more  freely  as  design  parameters 
which  we  can  select  to  suit  broader  purposes.  In  particular,  let 

Q(q)  =  Q0  +  q2BVBT 

R  =  R 

o 

where  Qo  and  Rq  are  noise  intensities  appropriate  for  the  nominal  plant, 
and  V  is  any  positive  definite  symmetric  matrix.  With  these  selections, 


1 


the  observer  gain  for  q  =  o  corresponds  to  the  nominal  Kalman  filter  gain. 
However,  as  q  approaches  infinity,  the  gains  are  seen  from  (5)  to  satisfy, 

K  R  KT - »c2  BVBT 

and 

K  - >q  B  Vj  Rj1,  (8) 

where  Vj  denotes  some  square  root  of  V  (VjVj  =  V)  and,  similarly,  Rj  is 
some  square  root  of  R.  Since  (8)  is  a  special  case  of  (2),  it  follows  that 
the  adjustment  procedure  defined  by  (4)-(7)  will  achieve  the  desired  robust¬ 
ness-improvement  objective. 

Note  that  the  second  term  in  equation  (6)  can  be  interpreted  as  extra 
process  noise  added  directly  to  the  control  input  of  the  plant.  Within 
the  constraints  of  Kalman  filter  mathematics,  such  "fictitious  noise"  is 
a  natural  mechanism  to  represent  uncertainties  at  this  point  of  the 
control  loop.  It  is  nice  to  know  that  the  resulting  filter  design  act¬ 
ually  responds  with  a  corresponding  robustness  improvement.  Note,  how¬ 
ever,  that  arbitrary  increases  of  the  existing  noise  matrix  (i.e., 

2 

Q  =  (1  +  q  )  Q  )  or  addition  of  arbitrary  full  rank  noise  process 
2  T 

(i.e.,  Q  =  Qq+  q  W  with  W  =  W  >o)  which  are  often  suggested  as  other 
intuitive  robustness  improvement  methods,  will  not  in  general  produce 
the  desired  effect. 

Finally,  we  note  that  the  use  of  Kalman  filter  equations  in  the  adjust¬ 
ment  procedure  is  not  fundamental.  The  filters  merely  provide  a  conven¬ 
ient  way  to  assure  stability  along  the  entire  adjustment  trajectory. 

Any  other  procedure  (pole  placement,  for  example)  with  the  same  limiting 
properties  (2)  could  be  used  as  well. 
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IV.  An  Example 

To  illustrate  the  observer  properties  and  adjustment  procedure  above, 
consider  the  following  example: 


Plant: 


dx 

dt 


— n 

0 

_ i 

O 
_ i 

’  35  " 

II 

x  + 

u  + 

1 

1 

OJ 

1 

J 

_-61  _ 

(9) 


wi  th 


y  =  l  2 

E  (0  =  E  (n)  =  0;  E 


1  ]  x  +  n 

c(t)?(r)|  =  E  ^n(t)n(x)j 


<5  ( t-r ) 


Controller: 


(10) 


u 


[-50  -10  ]  x  +  [50]  r 


(11) 


The  plant  in  this  example  is  a  (harmless)  stable  system  with  transfer  function. 


_JVC\  _  s  +  2 
<i[s‘  "  (s  +  l)(s  +  3) 

The  controller  happens  to  be  a  linear-quadratic  one,  corresponding  to  the 
performance  index 


(12) 


with 


X"w 


Hx  +  u  ;  dt 


(13) 


H  =  4  V  5 
It  places  the  closed  loop  regulator  poles  at 

s  =  -7.0  +  j2.0 


Y35 
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A  Nyquist  diagram  (polar  plot  of  the  loop  transfer  function  at  Point  X)  for 
the  full-state  design  is  given  in  Figure  2.  Gain  margin  is  infinite  in  both 
directions  and  there  is  over  85°  phase  margin.  The  design  is  then  implemented 
using  a  Kalman  filter  for  the  given  noise  parameters.  The  Nyquist  plot  for 
the  resulting  observer-based  controller  is  also  shown  in  Figure  2.  Oops... 
less  than  15°  phase  margin. 

In  an  effort  to  improve  this  margin,  one  adjustment  to  the  filter  that  could 
be  made  is  to  speed  it  up.  So,  we  can  try  moving  the  filter/observer  poles 
to  the  left  in  a  second-order  Butterworth  pattern.  For  the  f i 1  ter/observer 
poles  at  -22-17. 86 j  one  gets  the  third  Nyquist  plot  in  Figure  2.  As  can 
be  seen,  the  results  are  less  than  satisfactory.  Not  only  are  the  margins 
disappearing  (now  less  than  10  degrees)  but  the  loop  bandwidth  has  increased 
(crossover  has  gone  from  approximately  12.  to  40.  rad/sec). 

Unless  we're  trying  to  design  an  explosive  device,  this  is  clearly  undesir¬ 
able.  It  gets  worse  as  the  filter  gets  faster.  In  fact,  it  can  be  shown 
that  the  margins  go  asymptotically  to  zero  for  large  gains,  while  the  loop 
bandwidth  goes  to  infinity.  The  present  example  is  not  a  pathological  one, 
either.  Similarly  undesirable  characteristics  for  fast  filters  are  obtained 
with  most  systems. 

When  the  observer  adjustment  procedure  of  Section  III  is  applied  to  the 
same  example,  much  more  pleasing  behavior  is  obtained.  Following  (6)-(7), 
we  let  the  process  noise  covariance  matrix  be 
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We  then  increase  q  from  zero  until  a  reasonable  compromise  between  noise 
performance  and  robustness  is  achieved.  Some  results  of  this  process  are 
summarized  in  Figure  3  and  Table  1.  Figure  3  shows  Nyquist  diagrams  for 
=  100,  500,  1000,  and  10,000.  Margins  improved  with  essentially  no 
change  in  bandwidth  as  the  modified  loop  transfer  function  tends  toward 
full  state  optimal.  Noise  performance  is  summarized  in  Table  1  for  the 
same  set  of  q  values.  As  expected,  the  error  covariance  of  the  adjusted 
filter  with  respect  to  the  original  noise  increases  markedly  with  q. 
However,  there  was  not  the  same  deterioration  in  state  covariance. 


Table  1  also  documents  other  parameters  associated  with  these  design 
points  -  -  poles  of  the  error  dynamics,  margins,  and  filter  gains.  Note 
in  particular  that  the  filter  poles  tend  toward  the  plant  zero  and  toward 
infinity,  as  required  by  (3). 


This  adjustment  procedure  was  also  successfully  applied  to  reconstruction  of 
measured  outputs  after  sensor  failures  for  the  A-7D  aircraft.  M  In 
this  application  the  optimum  Kalman  filter  produced  an  unstable  syctem 
when  tested  in  hybrid  simulation  over  the  A-7D  flight  envelope.  After 
attempts  with  "ad  hoc"  fictitious  noise  adjustment  procedures  failed  the 
method  discussed  here  successfully  stabilized  the  system.  Also,  the 
resulting  error  covariance  properties  remained  closed  to  the  optimum 
values. 
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V.  Conclusions 

This  paper  illustrates  some  of  the  difficulties  one  can  get  into  by  relying 
on  observers  for  state  reconstruction.  We  have  concentrated  on  robustness 
properties.  In  general,  these  will  be  poorer  for  observer-based  implemen¬ 
tations  than  for  full-state  implementations.  For  minimum-phase  systems, 
however,  full-state  robustness  can  be  recovered  asymptotically  provided  it 
is  done  correctly.  Fast  observers  are  not  in  general  correct.  A  "fictitious 
noise"  adjustment  procedure  was  suggested  which  is. 

The  apparent  practical  value  of  this  procedure  is  that  it  gives  a  simple 
way  of  trading  off  between  noise  rejection  and  margin  recovery.  When 
q  =  0,  the  filter  will  be  optimal  with  respect  to  the  "true"  (as  modelled) 
system  noise.  As  g  increases  the  filter  will  do  a  poorer  job  of  noise 
rejection  but  the  closed-loop  stability  margins  will  improve.  Hopefully, 
a  satisfactory  compromise  can  be  found  through  the  adjustment  of  the  single 
parameter  q.  We  stress  that  margin  recovery  occurs  at  Point  X  in  Figure  1 
--  at  the  control  signal  interface  to  the  outside  world.  Asymptotical ly, 
the  full-state  and  observer-based  implementations  will  have  the  same  tol¬ 
erance  to  disturbances  and  uncertain  elements  inserted  at  this  point.  While 
Point  X  is  clearly  a  physically  important  one  (more  important  than  Point  XX, 
certainly),  engineers  who  may  wish  to  test  robustness  at  still  other  points 
in  the  control  loop  should  recognize  that  the  recovery  results  may  not  be 
applicable  there. 

The  suggested  adjustment  procedure  is  essentially  the  dual  of  a  sensitivity 
recovery  method  suggested  by  Kwakenaak  ^7  .  The  latter  provides  a  method 
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for  selecting  the  weights  in  the  quadratic  performance  index  so  that  full- 
state  sensitivity  properties  are  achieved  asymptotically  as  the  control 
weight  goes  to  zero.  In  this  case,  however,  closed  loop  plant  poles  instead 
of  observer  poles  are  driven  to  the  system  zeros,  which  can  result  in  unac¬ 
ceptable  closed  loop  transfer  function  matrices  for  the  final  system. 
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Figure  2.  Loop  Transfer  Functions  of  Example: 

"Fast  Filter"  Adjustment  Procedure 
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PHASE  ERROR  STATE  FILTER 

MARGIN  COVARIANCE  COVARIANCE  GAIN 


Table  1,  Summary  of  Example 


ADDENDUM  1:  DERIVATION  OF  PROPERTY  4 

Referring  to  Figure  1A,  the  loop  transfer  function  from  u"  to  u'  of  the  full 
state  implementation  is  obtained  from  the  relationships 

x  =  $(Bu"  +  FV)  ( A. 1 ) 

u'  =  -H,H2x  ,  (A. 2) 

where 

$  =  (sI-A)1  (A. 3) 

v  =  -G-|G2x  .  (A. 4) 

The  variables  v  above  are  now  shown  in  Figure  1  for  the  sake  of  simplicity. 

They  denote  the  (m-p)  control  components  for  which  loops  are  not  broken 
in  the  event  that  p  <  m.  Matrices  F,  Gpand  G2  are  to  control  input  matrix 
and  the  feedback  compensator  matrices  for  these  components,  respectively. 

If  the  original  plant  is  square  or  can  be  made  square  by  augmenting  (p-m) 
additional  control  variables,  then  v,  F  G^  and  G2  are  zero  identically.  For 
either  situation,  (A.l)  -  (A. 4)  define  the  following  full-state  loop  trans- 
few  function: 

u'  =  -H1H2  (I  +  4>FG1G2)"1  $Bu"  (A. 5) 

The  corresponding  relationships  for  observer-based  implementations  are 
(Fig.  IB). 

x  =  U"1  +  KC)"1  { Bu '  +  Fv  +  KO(Bu"  +  Fv)  > 
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=  (<t_1  +  KC)'1  {Bu1  +  KCfBu"  +  (t>~1  +  KC)  fFv} 

”  ($-1  +  KC)"1  (Bu1  +  KC$Bu"}  +  $Fv 

with 

u1  =  -H^H^x 
v  =  -G^x 

This  gives 

u 1  =  -HjH2(I  +  <!>FG1G2)‘1  ( 4>" 1  +  KC)"1  {Bu1  +  KC$Bu"}. 

Now  applying  the  Matrix  inversion  lemma  to  the  (<J>  1  +  KC)"1  term  in  this 
expression  gives 

u*  =  -HjHgd  +  $FG1G2)"1  [$-d>K(I  +  C«>K) "1C4>  ]  { Bu ‘  +  KUBu"} 

=  -h1h2(i  +  $fg1g2)"1  *[b-K(I  +  c*k)_1c*b]u' 

-H1H2(I  +  $FG1G2)'1  $K  (I  +  C$K)_1  C<t>B  u".  (A. 9) 

From  (A. 9)  it  follows  that  if  (1)  is  satisfied,  then  the  u1  term  on  the 
right  hand  side  vanishes  and  the  u"  term  is  identical  to  (A. 5).  Since  u" 
is  arbitrary,  this  establishes  the  claimed  equality  of  loop  transfer  functions. 


(A. 6) 

(A. 7) 

(A. 8) 
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